1. 01/18/11: Building Up to the Reals, Part One 

1.1. Symbols. 

We will start with a list of mathematical symbols that we will use throughout the 
course. 

V: for all 
3: there exists 
=> or implies 
*£=> : if and only if 
€: belongs to 

(x | condition}: set notation 
D: intersection 
U: union 

II: disjoint union, or if A = B II C, then A = B U C and B D C = 0 
S\A: set difference, or {x € S \ x A} 

An example of a formula written (almost) completely in symbols: 

(Ve > 0)(3<5 > 0) s.t. (\x - y\ < 6 => | f(x) - f(y)\ < e) 

1.2. The Natural Numbers, or N. 

The main idea for the first part of the course will be R, or the real numbers. There 
are three main ways to prove their existence: decimal expansions, Dedekind cuts, 
or sequences of rationals. We will eventually use a hybrid of the second and third 
methods, but that is for later. For now... 

N = {1, 2, 3, 4, 5, 6, . . . }*. This is a commutative semiring with an identity (built 
off 1 with operators + and •). There is a notion of order, or x > y, contained in 
the algebraic structure of N. 

Axiom (Induction). If S C N and: 

(1) leS 

(2) ieS^(i + i)eS 
hold, then S = N. 

In other words, if the two conditions above are true, then nothing can fail to be in 
S. Note that we will say 0 ^ N. 

1.3. The Integers, or Z. 

Z = N U {0} U (— N). This is a commutative ring with multiplicative identity, 
meaning that it is an abelian group under (+,0) and is associative, commutative, 
and distributive (i.e. x(y + z) = xy + xz) under multiplication. We also define 
Ox = 0 Vx. 

Note that a group G is a set with an operation * such that g-kh G G for g, h e G, 
along with these properties: 

(1) G has an identity e, for which the following holds: e-kg = g-ke = g Vg. 

(2) (g k h) k k = g * (h* k) 

(3) (' S/g € G)(3h € G ) such that gkh = e = hkg. 


*Read the book for notes on their structure. 
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An abelian group is a group with the property that gkh = hkg. From the properties 
of a group, it follows that the h in (3) is unique, namely h = g^ 1 or —g, and that 
(a kb = a-k c) =$■ b = c. 

There is an order on Z, or some notion such that x > y. Namely, 
x > y *£=> x — y € N U {0} . 

We then obtain three properties about this ordering: 

(1) x < x 

(2) (x < y and y < x) => x = y 

(3) (x < y and y < z) => x < z 

These are the axioms of a partially ordered set. Another example is the ordering 
on the subsets of a set with C instead of <. 


1.4. The Rationals, or Q, an Ordered Field. 

Q = { — | (m, n) = 1 and m,n € Z and n ^ 0}. Note that (x,y) is equivalent to 
the expression gcd {x,y). 

We will define an order on Q: Let V = | m G N, n € N}. Then, 

x < y y — x £ V or y — x . 

Definition. A field, F is a set with two operations +, • and two distinguished 
elements 0, 1 such that, for 0^1, 

• (F, +0) is an abelian group 

• (F \ {0}, •, 1) is an abelian group 

• x(y + z) = xy + xz 

As a precaution, we can extend • to all of F by Ox = 0 Vx. 

Q is not only a field, however, but also an ordered field. 

Definition. An ordered field is a field F with a subset V C F with the property 

F = V II{0}II-'P 

where —V = {—p \p € V}, and axioms 

(1) V + V C P, where V + V = {pi +p 2 \pi,P 2 € V) 

( 2 ) V ■ V C V, where V ■ V = {p\ • P2 \ Pi , P2 € V} 

Proposition. 1 G V. 

Proof. We will proceed by contradiction. Note that if x € V, then (—1)® € —V. 
Then, if 1 G —V, then (—1) G V , which is a contradiction because (—1) • (—1) = 1, 
but l£V. □ 

Proposition. x~ x € V . 

Proof. We will proceed by contradiction, and assume that x~ x G —V. If that is the 
case, then x ■ (—a: -1 ) = —1. Then, we obtain a contradiction because x £ V and 
(—a; -1 ) e V, but —l^V. □ 
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Thus, given an ordered field (F, +, •, 0, l,V), we can define: 

x <y [x < y\ •<=>■ y — x € V U {0} [y — x G V] . 

This ordering gives us the following consequences, taken as axioms in other sources 
such as the book: 


(1) a < b —b < —a 

(2) c > 0 => ac < be 

(3) a 2 > 0 

(4) (0 < a, 0 < b) => ab > 0 

(5) a > 0 => a- 1 > 0 

(6) 0<a<6=»0< 6” 1 < a -1 
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2. 01/20/11: Building Up to the Reals, Part Two 

2.1. More on Q. 


Last time, we discussed ordered fields (F, +, ■, 0, 1, V) where F = V II {0} II —V, 
and defined an order x < y •£=> y — x € {0} U V . Note that if x,y € F, then 
either x < y or y < x. This property is known as the Total Order Property. 

Now, it’s time for our first proof. 

Theorem. The equation x 2 = 2 has no solution in Q. 


Proof. By contradiction; suppose x € Q satisfies x 2 = 2. Since (— x ) 2 = x 2 — 2, 
we may suppose x is positive. Write x = — with m,n GN and (m, n) = 1. Since 
x 2 = 2, (^) 2 = 2, which means that: 

(*) m 2 = 2 n 2 . 

Therefore, m 2 is even. However, because the square of an odd number is odd, it 
follows that m is even. Say m = 2 k with k G N. Substituting m = 2k in (*), we 
see: 

2 k 2 = n 2 * 


So n 2 is even, and by a previous argument, n is even. However, this means that 2 
divides both m and n, contradicting (m, n) = 1. □ 


Note: When writing proofs, make sure that you are thinking about whether what 
you’re writing makes sense and whether you’re writing too much. 


2.2. Terminology. 

Let ( X , <) be a poset, and let S ^ 0 be a subset of X. 

Definition. S is bounded above if there is an x G X with x > s for all s G S. 
Such an x is called an upper bound for S. 

Definition. Same as above , but with below, x < s, lower bound. 

Definition, x G X is a least upper bound for S if 

(1) x is an upper bound. 

(2) If y is an upper bound for S, then y > x. 

The least upper bound of S is called the supremum and is denoted sup S' or VS. If 
|S| < oo, we can write S = {xi,X 2 , • ■ • , x n }. In this case, sup S = max{a:i, X 2 , . . . ,x n 

Definition. Same as above, but with greatest lower, lower bound, y < x. The 
greatest lower bound of S is known as the infimum and is denoted inf S or AS. If 
|S| < 00 , we can write S = {x\, X 2 , ■ ■ ■ , x n } ■ In this case, inf S = min{xi,a; 2 , . . . , x n } 

Note: If sup S or inf S exists, then it is unique. 

Examples: {q G Q | 0 < q < 1} has a supremum, 1. {q G Q | q 2 < 2} has an upper 
bound, but no supremum. 

Definition. An ordered field is called complete if every subset S C F which is 
bounded above has a least upper bound. 


Note that we removed the substitution step. 
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2.3. The Reals, or R, the Complete Ordered Field. 

R is a complete ordered field. Note that all complete ordered fields are isomor- 
phisms of one another, so there is only one complete ordered field. 

Proposition (e-characterization of the supremum). Let S C R, r £ R. Then 
r = sup S if and only if 

(1) r is an upper bound of S, and 

(2) (Ve > 0)(3s € S ) with s > r — e. 

Proof. We will go in both directions. 

(=») (1) is trivial. For (2), let e > 0 be given. By contradiction, suppose no 
such s exists, i.e. Vs e <5, s < r — e => r — e is an upper bound. However, 
r — e < r, so r is not the least upper bound, and we have a contradiction. 
(*^=) By (1) we only have to show that r is the least upper bound. Suppose p is 
an upper bound for S (namely, p> S), and p < r. Apply (2) with e = r — p 
to obtain an s € S such that s > r — (r — p) = p, which contradicts that p 
is an upper bound. 

□ 

Theorem. R is Archimedean, i.e. Va € R3?z £ N such that n > a. Equivalently, 
Vo € R (a > 0) 3n G N such that A < a. 

Proof. By contradiction, suppose there is an a > N. Then, N is bounded above. 
By the completeness of R, we can let s = supN. By the e-clraracterization of the 
supremum with e = 1, we obtain that 3o € N with n > s— 1. However, this implies 
that n + 1 > s, which is a contradiction. □ 

Theorem. ‘IQ is dense in R”, i.e. \/a,b € R where a > 0 and b > a,3q € Q such 
that a < q < b. 

Proof. We know that b ~ a > 0, so > o. Therefore, by the Archimedean 
property, we can choose an m such that m > jA-, which is equivalent to saying 
mb—ma > 1. Consider {n € N | n > ma}. This set is nonempty by the Archimedean 
property. Let p be its least element (as a subset of N). Then, p < mb, because if 
p > mb, then p — 1 would be greater than ma. Therefore, ma < p < mb, which 
implies a < A- < b. □ 

Note: In this proof, we have implicitly assumed that a > 0. However, this does not 
cause any problems for us. 
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3. 01/25/11: Completeness and Sequences 

3.1. Completeness. 

Theorem. The equation x 2 = 2 has a solution in R. 

Proof. Let S = {x £ R | x 2 = 2, x > 0}. Then, S is nonempty, because 1 G S. S is 
also bounded above, because if x, y > 0, then 

x 2 < y 2 => x 2 — y 2 < 0 => (a: — y) (x + y) < 0 => x — y < 0 

so x < y. Thus, if y = 2, then y 2 = 4 > 2, so 2 is an upper bound for S. Therefore, 
by the completeness of R, sup S exists. 

Let x = sup S. We want to show x 2 = 2. 

To show x 2 cannot be less than 2, we will assume that x 2 < 2 and try to show 
that we can add e > 0 to x such that (x + e) 2 < 2, so that x is not an upper bound 
for S. 

Scratchwork: We have x 2 + 2ex + e 2 < 2 =t> 2ex + e 2 < 2 — x 2 = 6. So, we will 
try to make 2ex and e 2 both less than | . Choose e < ^ for the first term and 
e < min{l, |} for the second term. 

So, back to the proof, choose e to be less than min{l, |}, where 5 = 2—x 2 > 0. 
Then, we obtain: 

(x + e) 2 = x 2 + 2ex + e 2 < x 2 + 6 = x 2 + 2 — x 2 = 2 . 

Now, we must show that x 2 cannot be greater than 2. We will use the e- 

characterization of the supremum, and try to find an e > 0 such that (x — e) 2 > 2, 
so that x is not the supremum of S. 

Scratchwork: We have x 2 — 2ex+e 2 > 2 => x 2 — 2 > —e 2 +2ex. Let <5 = a; 2 — 2 > 0. 
We want to make 2ex less than |. We can choose e < ^. 

So, back to the proof, choose e to be less than Then, we get: 

(x — e) 2 = x 2 — 2ex + e 2 > x 2 — 2ex > x 2 — 5 = 2. 

We know that x — e < x, but this implies that x — e > s for all s £ S, which is a 

contradiction because x is supposed to be the least upper bound of S. 

Therefore, a: 2 must equal 2, and thus x = sup S' is a solution to the above 
equation in R. □ 

This leads to the fact that every positive element in R is a square, a fact which 
again uses the completeness of R. 

3.2. Infinity. 

oo is a very nice symbol, with the properties that oo > r and — oo < r for all 
r G R. 

sup S = oo means that S is not bounded above. 

Recall interval notation: [a, b) = {a: | a < x < b}, (a, b] = {x \ a < x < fr}, and so 
on. Likewise, we define: 

[a, oo) = {x | a < x} 

(-oo,?/) = {x\x < y} 

and so on. 
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3.3. Sequences. 

Definition. A sequence beginning at m is a function from {n € Z \ n > mj to K, 
or some other set, and is denoted (s n ). 

Note: We need for a sequence to be well-defined, such as (s„) = n 2 or (s n ) = (— 1)", 
not just something like (0, 0, 2, . . . ). 

Definition. lim., ; ^ oc (,s ri ) = s, or s n -+ s, is equivalent to: 

(Ve > 0)(=hV e N) s.t. (n > IV) +> |s n — s\ < e . 

Note: There are two irrelevancies in this definition: n> N and |s n — s| < e lead to 
the same definition. Also, think of |a — b | as the distance between a and b. If you 
add the condition that e £ Q, it is still the same definition by the density of Q. 

Example: lin+^oo = |. 

Scratchwork: Notice that for any n, it is the case that: 

1 + n 1 3 + 3n — 1 — 3n 2 

Sn ~ s ^ 1 + 3 n ~ 3 ~ (1 + 3?r)3 “ 3 + 9n 

and this is the same regardless of the absolute value sign. Therefore, we want 
— - — < e 

3+9n ^ c - 

2 2 2 1 2 

- — — <e=>-<3 + 9 n=> 3 < 9 n => n > - ( 3) 

3 + 9n e e 9 v e 

Proof. Let e > 0 be given. Choose any N £ N such that N > |( 2 — 3). Then, for 
n > N: 

1 + n 1 2 ^ 2 

1 + 3n ~ 3 _ 3 + 9n < 3 + 91V < C 

□ 
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4. 01/27/11: Convergence, Monotone Sequences 

4.1. Some Basic Notes. 

If A C B C R. and B is bounded above, then sup A < sup 13 . 

Proposition. If ( s n ) is a sequence where lim s n = s and lims n = t, then s = t. 

Proof. Suppose s t and put e = //,* into the definition of the convergence of 
a sequence. Then, choose N such that n > N => |s n — s\ < p/p . Also, since 
lims n = t , choose M such that n > M =t- |s„ — t\ < p/p. Choose k such that 
k > M and k > N. 

Then, |s— 1 \ < |s— Sfc| + |sfc— 1 \ by the triangle inequality. However, then |s — Sfc| < 
p/p and | Sfc — t\ < p/p, which implies |s — t\ <2 ^p/p) , a contradiction. □ 

As an aside: The Triangle Inequality states that for a, b, c € R, \a— b\ < |a— c| + | 6 — c|. 

This follows from the slightly easier assertion that \a + b\ < |a| + | 6 |, in which 
you can define a = a — c and b = b — c. 


4.2. Bounded Sequences. 

Definition. ( s n ) is bounded above if {s„ \ n € N} is bounded above, and similarly 
for bounded below. (s n ) is bounded if {s n \ n £ N} is bounded above and below. 

Proposition. A convergent sequence is bounded. 

Proof. Suppose s n — > s, or lim^^oo s n = s. Then by definition there exists an N 
such that s — 1 < s„ < s + 1 for all n > N. 

Let M = rnaxjsi, S2, . . . , sat, (s + 1)}. Clearly s n < M for all n. Then, let 
m = minjsi, S 2 , . . . , Sat, (s — 1)}. Clearly s n > to for all n. □ 

Theorem. Given s n — > s and t n — > t, we have: 

(1) s n -\- t n — ► s + i. 

( 2 ) s n t n y st. 

(3) Ift n ^= 0 for all n and t ^ 0, then lim ^ = |. 

Proof. We will only prove (2), as the others are similar. 

Scratchwork: We are working with \s n t n — s<|, so we will write it as 

\{s n t n - s n t) + ( s n t - si) | < | s n t n - s n t\ + | s n t - st| = |s„||t„ - t\ + |s„ - s||t| 

However, we know that all four expressions are bounded, so we are ready, and the 
formal proof follows. 

By the previous result, choose B > 0 such that |s n | < B for all n. Now since 
t n t , choose Ni such that ( n > Ni) | t n — 1 1 < 2 I 3 where e > 0 is given. 
Also, since s n — ► s, choose N 2 such that (n > N 2 ) => |t||s ra — s\ < f. Now, choose 
N = maxjiVi, N 2 }. Then, if n > N: 

| S n t n - st\ < I S n t n - S n t\ + \s n t - st\ = \s n \\t n - t\ + |f||s n - s\ . 

Therefore, since |s n ||t„ — t| < B ■ ^ = | because n > Ni and |i||s n — s\ < | 
because n> N 2 , their sum is less than or equal to | + | = e. □ 
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Note: This theorem is very convenient! For instance: 

1 + n _ 1 + i 1 

l + 3n _ 3+i^3' 

So what about when a sequence doesn’t converge? Well, first of all, an un- 
bounded sequence obviously doesn’t converge. But what about s n = {— l) n ? 

If this sequence converges, then for all e > 0, then for all sufficiently large n, 
|s n — a| < e. However, if n is odd, then |1 + a\ < e and if n is even, |1 — a\ < e. 
This means: 

2= |1 — (—1)| < |o — 1| + |a + 1| <2e 
Set e = |, and we have a contradiction. 

4.3. Monotonic Sequences. 

Definition. A sequence ( s n ) is nondecreasing if s ra +i > s n for all n. ( s n ) is 
nonincreasing if a n > a„ + i for all n. ( s n ) is monotonic if it is either nonde- 
creasing or nonincreasing. 

Theorem. In an ordered field F, F is complete if and only if every bounded mono- 
tone sequence converges. 

Proof. In next lecture. □ 
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5. 02/01/11: Monotone, limsup, Cauchy 

5.1. Monotone Sequences, continued. 

Theorem. In an ordered field F, F is complete if and only if every bounded mono- 
tone sequence converges. 

Proof. We will go in both directions. 

(=>) Let (s„) be monotonic and bounded. Without loss of generality, suppose 
(s n ) is nondecreasing. Then, {s ra | n € N} is bounded above and nonempty. 
By completeness, there exists an s = sup{sjv | n € N}. 

We will claim that s n -A s. Let e > 0 be given. We want to find an 
N such that if n > TV, then |s„ — s| < e. By the e-characterization of the 
supremum, there exists N £ N such that sjy > s — e. Then, for all n> N, 
we have: 

sn fi s n < s => s — e < sn < s n 
which implies |s n — s| < e. 

(<=) We will again assume, without loss of generality, that (s n ) is nondecreasing. 
Let S' 0 be a subset of F that is bounded above by B. We must show 
the existence of supS. We will construct inductively two sequences, (x n ) 
and (y n ), with the following properties: 

(1) x n £ S and y n is an upper bound for S. 

(2) x n+ i > x n and y n+1 < y n . 

(3) |x n _)_i yn+i| S 2 !*^^ Vn\- 

To do this, let xo £ S and yo be any upper bound for S. Suppose 
x\, X 2 , ■ ■ ■ , x„ and t/i , 2 / 2 , • • • y n are already constructed, and satisfy the 
three properties. Then, either Xn + Vrl is an upper bound for S or it is not. 
If it is, then set x n +\ = x n and y n + 1 = Xn ff Vn . If it is not, then there is an 
s £ S such that s > Xn + yn . Set x n +\ = s and y n + 1 = y n - Note then that 
every x n stays in S and every y n is an upper bound for S, so (1) is satisfied. 
By construction, (2) is true, and so is (3). Therefore, the sequence we have 
constructed satisfies all of the given properties. 

Note that (x n ) is a nondecreasing sequence bounded above by t/o and 
that (y n ) is a nonincreasing sequence bounded below by Xq. Therefore, by 
hypothesis, there are x,y £ F such that x n — > x and y n — > y. We will claim 
that x = y. It is obvious from (3) that \x n — y n \ < ^ \xo — yo\- Suppose for 
the moment we can show that grr — > 0. Then, by choosing sufficiently large 
n, it will be the case that for any given e > 0, \x — x n \ < e, \y n — y | < e, 
and \x n — y n \ < e*. Then, we can obtain that: 

\x - y\ = \x - x n + x n - y n + y n - y\ < \x -x n \ + \x n - y„ \ + | y n - y\ ■ 
Therefore, \x — y\ < 3e, so x = y. 

However, we still need to show that W — ► 0. We know W is a nonin- 
creasing bounded sequence, so it does have a limit z £ F. Also, by the 
elementary properties of limits which are valid in any ordered field, the 
sequence (2^) — > 2 z. However, the limit of (2^) is the same as that of 
A-. Therefore, 2 z = z, which means that z = 0. Therefore, we now know 
that x = y. 

‘This condition is what we need the convergence of 7 / 7 - for. 
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Finally, we need to show that x = y = sup S. y is an upper bound for 
S because y n > s for all s G S and for all n £ N, so y > s for all s £ S as 
well. Also, if there existed an upper bound t < y, then there would be an 
x n such that x n > t, because ( x n ) — > x. Therefore, t cannot be an upper 
bound, and thus y is the least upper bound. 

□ 

Note: The way we proved that x — y is equivalent to proving lim(a: n — y n ) = 0, 
which, for convergent sequences, implies that lim 2 + = lim y n . 

Definition. 

lim s n = +oo <*=> VM e R, (31V £ N) s.t. (n > IV) => ( s n > M). 

n—>o o 

lim s n = —oo VM £ R, (3 N £ N) s.t. ( n > N) =$■ ( s n < M). 

n—>o o 

Note: oo is not a number. 

Proposition. Any unbounded monotone sequence tends to oo or — oo. 

Proof. The proof is supplied in the textbook (10.4). □ 


5.2. lim sup, or lim, and lim inf, or lim . 

Suppose ( s n ) is a sequence in R. Let T n = {sk \ k > n}*. It is obvious that 
T n 2 Tn+i 2 Tn + 2 2 . . . , and if A C B for any sets A and B , then it is the case 
that sup A < sup B and inf A > inf B. 

Therefore, the sequence (supT„) is nonincreasing and the sequence (infT„) is 
nondecreasing. By the completeness of R as well as the “suitable consideration” of 
±oo in the unbounded cases, limn^oo supT„ and lim n ^. (X) inf T n always exist! 

Examples: lim sup (— 1)™ = 1 and lim inf (— 1)" = — 1. 

Let s n be defined such that s n = 1 — - if n is even and s n = —n if n is odd. Then, 
lim sup (s„) = 1 and lim inf (s n ) = — oo. 

Let s n be defined such that s n = 1 + ^ if n is even and s n = — n if n is odd. Then, 
limsup(s„) is still l! 

Remember: lim sup, lim inf always exist. 

Theorem. Let ( s n ) be a sequence. Then: 

(1) s n — > s => lim inf s n = lim sup s n = s 

(2) If lim inf s n = lim sup s n , then lim s n = lim inf s n = lim sup s n . 

Proof. We will prove each part. 

(1) We know that (Ve > 0)(3iV) s.t. {Tn} C (s — e, s + e). Therefore, sup Tn C 
[s — e, s + e] , and sup T n C [s — e, s + e] for n > N . Because this is true for 
all e, limsups ra = s. The proof of lim inf is similar. 


*The T stands for “tail/ 
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(2) Suppose limsups n = r = liminfs n for some r £ R. Let e > 0 be given. 
We want to show that s n —> r. We know that: 

3Ni s.t. sup T n < r + e \/n > Ni and 
3N 2 s.t. inf T n > r — e Vn > N 2 . 

Let N = maxjfV!, V 2 }. Then, if n > N, s n € T n , so s n < sup T n < r + e 
and s n > inf T n > r — e, which implies \s n — r\ < e. 

□ 


5.3. Cauchy Sequences. 

Definition. Let (s n ) be a sequence of real numbers. We say ( s n ) is Cauchy if: 

(Ve > 0)(3N £ N) s.t. ( m,n > N) => (|s n — s m \ < e) . 

Note: This makes sense in spaces with an arbitrary notion of distance. 
Proposition. A convergent sequence is Cauchy. 

Proof. Assume s n — > s for a sequence (s n ). Let e > 0 be given and choose N so 
that (n > N) => |s ra — s| < |. Then, if m,n > N, we obtain: 

| s m - Snl = |s m - S + S - S n | < \s m - s\ + \s - S m | < | | = £ ■ 

□ 
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6. 02/03/11: Cauchy Sequences, Subsequences 

6.1. A Simple Proof. 

Say we want to show that for 0 < r < 1, r n — >■ 0. 

One way to show this is to assume r n x. Then, we know that kr n -A kx. Let 
k = r. Then, rr n — > rx , but r n+1 has the same limit as r n . Therefore, rx = x and 
x = 0. 

Another way is to show that (l) n — > oo, as that implies r n — > 0. Write - as 
1 + b > 0. Then (1 + b) n > 1 + nb , which tends to oo. 


6.2. Cauchy Sequences, again. 


Last time, we learned about limsup, liminf, and Cauchy sequences. Recall that 
(s„.) is Cauchy if and only if: 

(Ve > 0)(3 N e N) s.t. (n, to > N) => |s„ — s m | < e . 

Note: This definition makes sense in any ordered field. 

Proposition. A Cauchy sequence is bounded. 


Proof. Choose e = 17 (arbitrarily, of course). Then, we know that 
3N e N s.t. Vn, to > N, |s„ — s m | < 17 . 

This means that for n> N, |s„ — Sn\ < 17, or — 17 < s n < s^ + 17. So for all 
n, it is the case that 


s n < max{si, s 2 , ■ ■ ■ ,sn-i, sn + 17} 

and likewise, 

s n > min{si, s 2 , • • • , sjv-i, sjv - 17}. 


□ 


Theorem. If (s n ) is a sequence in R, then (s„) is Cauchy if and only if (s n ) 
converges. 

Proof. We will proceed in both directions. 

(*t=) This was proved in the previous lecture. 

(=>) Let (s n ) be a Cauchy sequence in R. Note that because (s„) is bounded, 
lim sup s n and lim inf s n exist and are real numbers. Therefore, it suffices 
to show that liminf s n = lim sup s n . Because liminf < limsup in all cases, 
we only need to show that liminf s n > lim sup s n . To do this, we will show 
that liminf s n + e > lim sup s n for any e > 0. 

Let lim sup s n = x and lim inf s n = y. Let e be given, and choose an 
N € N such that |s n — s m | < e for n,m > N. Note that this implies 
s n — Sm < e. Then, because lim sup s n = x, there exists an n > N such 
that s n > x — e, and similarly there exists an to > N such that s m < y + e. 
Therefore: 


x - y = x - s n + s n - s m + s m - y < 3e . 


□ 
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Proposition. Let (s n ) be a sequence in an (Archimedean) ordered field. Then, if 
there exist k,r (where 0 < r < 1) such that |s„ — s n +i| < x n k for all n, then (s n ) 
is Cauchy. 


Proof. Let e > 0 be given. Choose N such that n > N => r n < This is 

possible because r" — ► 0, which we may need Archimedean for. Without loss of 
generality, we will assume that m > n. Then, for n, in > N , we have: 

Sm\ = |^n ^n + 1 d" ^n+1 ^n+2 T ' ' ' T Sm—1 Sm\ — 


|Sn — Sn+l| + |s n +l — Sn+ 2I + ' ' ' + | Sm— 1 H - Sm | < fcr"(l + r + ■ 

! — j.m—n+1 \ kr r, 


kr r ‘ 


1 — r 


< 


1 — r 


< e 


□ 


Theorem. If F is an ordered field, the following are equivalent: 

(1) F is complete, i.e. every nonempty subset bounded above has a supremum. 

(2) Every nondecreasing bounded sequence converges. 

(3) Every Cauchy sequence converges (We may need F is Archimedean) . 

Proof. By our previous results, we only need to prove (3) => (1). To do this, we 
will refer back to our proof of (2) => (1). 

We will show that (x n ), ( y n ) from the aforementioned proof are Cauchy. This 
would show that by assuming Cauchy sequences converge, we can get to the com- 
pleteness of F. 

We know that \x n — x n+ i\ < ^\xq — yo\ because x n < x n+ i < y n , and similarly 
for y n+ 1 . Therefore, ( x n ) and ( y n ) are Cauchy, and lim.Xn = x, lim y n = y for some 
x, y € R. The rest of the proof follows in exactly the same way as the proof for 
nondecreasing bounded sequences. □ 

6.3. Subsequences. 

Definition. For ( s n ),n € N given, a subsequence of s n is a sequence of the form 
(tk | t k = s nk ) with n k < n k+1 < .. . for all k. 

Example: Take the sequence (n). (2 n) is a subsequence of (n), but (1) is not. 
However, if our sequence is {1,2,3, 1,2, 3,...}, then (1) is a subsequence. 

Proposition. If s n — > s, then any subsequence of s n tends to s. 

Proof. Let ( s nk ) be a subsequence. Let e > 0 and linin^oo s n = s be given. Choose 
N such that n > N => |s ra — s| < e. Then, if k > N, then \s nk — s\ < e because 
n k > N . □ 

Theorem (Bolzano- Weierstrass). In R, any bounded sequence has a convergent 
subsequence. 

Proof Sketch. Take the interval in which the sequence lies, and divide it in half. 
Then, choose a half with infinitely many terms (there must be at least one) and 
pick a term in that interval. Then, divide that half in half and choose a half with 
infinitely many terms again. Pick another term from that half, such that that term 
appears later in the sequence than the first. Repeat this sequence indefinitely. This 
will lead to a limit for the subsequence that you will have picked. □ 
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7. 02/08/11: Defining the Reals, Part One 

7.1. Equivalence Relations. 

Definition. Given a set S, an equivalence relation on S is a relation x ~ y with 3 
properties: 

(1) x ~ x \/x £ S (Reflexivity) 

(2) x ~ y => y ~ x (Symmetry) 

(3) x ~ y and y ~ z => x ~ z (Transitivity) 

Given x £ S, define [x] = {y | y ~ x}. 

Here are some facts about [x]: 

(1) X ~ y 4=+ [x] = [y] 

(2) [x] PI [y] = 0 if x y and [x] D [y\ = [x] if x ~ y. 

Therefore, S is the disjoint union of equivalence classes. 

However, if S = 1 Lei Si, then define ~ by: 

x ~ y +=+ 3 i £ I s.t. {x, y} C 

It is easy to check that this relation is an equivalence relation, meaning that a 
partition on a set gives you an equivalence relation, not just the other way around. 


7.2. Defining the Reals. 


The Equivalence Relation. First, we will define a relation ~ on sequences (s n ) of 
rationals, such that (s n ) ~ (t n ) if and only if: 

lim s n — t„ = 0, i.e. (Ve > 0, e £ Q) 3 N s.t. n > N => \s n — t n \ < e . 

n—>o o 

This is an equivalence relation. Note that in an Archimedean field, (Ve > 0) can be 
replaced by (Ve > 0 | e £ Q), by the denseness of the rationals. 

We will show that if (s n ) is Cauchy and (s n ) ~ (t„), then (t n ) is Cauchy. We 
know that |s n — s m | < e and want to show that this implies \t n — t m \ < e. 

I t n t m | = | t n s n + s n s m + s m t m | ^3 | t n s n | J- |s n s rn -f- 1 s m t m | < 3e 

Therefore, (t n ) is Cauchy. 

So, we will define F to be the set of equivalence classes of Cauchy sequences. We 
will give it the structure of an ordered field and show it is complete. 


Checking the Field Properties. First, we will define + such that [(«„)] + [(£„)] = 
[(s n + t n )\. We must check to make sure that this is well-defined. Suppose (s n ) ~ 
(4) and (t n ) ~ (4). Then, we know that lims„ — s' n = 0 and limt n — t' n = 0. 
Therefore: 


lim(s„ - s' n +t n - t' n ) = lim((s n + t n ) - (s' n + t' n )) = 0 + 0 = 0 

and + is well-defined. Let [(0„)] be the additive identity and note — [(s n )] = [(— s n )], 
so inverses exist. + is also commutative, so this is an abelian group. 

Next, we will define • such that [(s n )] • [(f n )] = [(s n £ n )]. Again, we want this to 
be well-defined. First, we will check that ( s n t n ) is also Cauchy: 


l^r+n Smt-m \ — S n t n $ntm + Sntm Smtm\ "S S' r 
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Obviously, the rightmost side goes to zero, so ( s n t n ) is Cauchy. Now, suppose 
lims n — s' n = 0 and limi n — t' n = 0. We want to show that lim(s n t n — s' n t' n ) = 0. 


S'nfn I ^nfn I V S r/ 1 1 t n tj, 


Again, obviously, the rightmost side goes to zero, so multiplication is also well- 
defined. It is obviously commutative, associative, distributive over addition, and 
has an identity, namely [(1„)]. However, the existence of inverses is not trivial. For 
this, we will make an important observation. 


Proposition. Let ( s n ) be a Cauchy sequence of rationals. Then, either: 

(1) s n — > 0, 

(2) 3N s.t. s n > e Vn > N , or 

(3) 3 N s.t. s n < — e Vn > N. 
where e € Q and e > 0. 


Proof. Suppose s n does not converge to 0. Then, the negation of the definition of 
convergence gives us that: 

3e > 0 s.t. \/N e N, 3r > N s.t. |s r | > e . 

By the Cauchiness of (s n ), there exists an N s.t. |s n — s m \ < | Vn , m > N , where 
e is the same as the e in the above expression. Choose the r guaranteed for this e 
such that r > N and |s r | > e. 

Suppose s r > e. Then, for n > N, we have |s r — s n | < |, so s n > |, which is 
case (2). 

Now, suppose s r < — |. Then, for n > N , we have |s r — s n | < |, so s n < — 
which is case (3). □ 


Note that it is obvious to see that (1), (2), and (3) depend only on the class of (s n ). 

If [(s n )] 7 ^ [(On)]! then s n does not converge to 0, and we are in case (2) or (3). 
Then, we can change finitely many terms, by the above proposition, in order to 
have s n ^ 0 for all n. Then, [(s n )] • [(y-)] = [(In)], but we must also make sure 
(j-) is Cauchy. We obtain: 

Sn Sm 
SnSm 

where |s„| < B, because Cauchy sequences are bounded. 

Therefore, finally, we have established that this is an abelian group under mul- 
tiplication, and thus that F is a field which contains the rationals as constant 
sequences, i.e. q £ Q is defined as (g„). 




Ordering the Field. We will define V as such: 

V = {[(s n )] I 3 IV, e > 0 with s n > e Vn > N for some, hence any (s„) € [(«„)]} . 

Essentially, V is the set of equivalence classes of Cauchy sequences that fall into 
category (2) of the above proposition. This trivially satisfies all of the conditions 
necessary for an order. 

Observe immediately that F is Archimedean. For some [(s n )], s n < k for some 
large integer k, because Cauchy sequences are bounded. Thus, 2k — s n > 0 for all 
n , and (2 k n ) therefore bounds (s n ) for all n. A similar argument can be used to 
establish the nonexistence of infinitesimals. 


16 



Math 104, Spring 2011 Vaughan Jones 


Lecture 8 


8. 02/10/11: Defining the Reals, Part Two 

8.1. Recap. 

Recall that the intuition of this construction is that we are approximating reals 
by sequences of truncations of rational approximations of each real number; this is 
where the notion of equivalence classes comes from. 

So far, we have that the additive group with identity [(0„)] and multiplicative 
group with identity [(l n )] exist and are abelian. Therefore, the previously defined F 
is a field. Also, we have an order with V = {[(s n )] | case two of the proposition from 
last time}, so F is an ordered field. Furthermore, F is Archimedean because given 
a Cauchy, and thus bounded, [(s„)], there exists a q > s n +e for all n where gSN, 
so in the field, “q” > [(s„)]. Thus, we will use the fact that in an Archimedean 
field, if all Cauchy sequences converge then it is complete in order to prove the 
completeness of F. 

8.2. Defining a Concept of “Less Than”. 

Note that |[(s„)]| = [(|s„|)]. We could define a notion of “less than” as such: 

I Ml < e => e — [(|s n |)] > 0 => 3ry > 0 s.t. for large n, e- |s„| > rj, or |s„| < e-ry 

In this definition, e, 77 , s n are all rationals. This is a perfectly serviceable definition, 
but in order to get away from ?y, we will use an alternate definition. 

Definition. “[(s n )] is less than e” is defined through these two implications: 

(1) [(«„)] < e => 3N e N s.t. s n < e Vn > N , and 

(2) 3 N g N s.t. s n < e Vn > N => [(s„)] < e. 

Now, we are finally ready. 

8.3. Convergence of Cauchy Sequences in F. 

Theorem. Every Cauchy sequence in F converges. 

Proof. What we have to do is given ([(s„)] m ) Cauchy, come up with a [(t n )] where 
lim rra _ > 00 [(s„)] m = [(f„)]. Our notation will be: 

[(Sn)]l = Sl,lj S2,lj S3,l) S4,l, ■ • ■ 

[(Sn)]2 = Si, 2, S2,2, S3, 2, S4 ; 2, . . . 

[(s n )]3 = Si )3 , S 2 , 3 , S 3> 3, S4 j3 , . . . 


[(Sn)]/.' s l,ki S 2 ,A;5 S 3i fc, S4 fc, . . . , Sfc^, . . . 

We are going to shoot for the diagonal, (s ra>n ). However, we are dealing with 
equivalence classes of Cauchy sequences, so we could have made a bad choice of 
representatives and ( s n>n ) may go to infinity. Therefore, we will change [(s„)]fc so 
that it only varies by £ in each term. We will do this by changing all elements 
before N (Note, a finite number) so they all live within e of the next, or, more 
formally. . . 

Proposition. Let (s n ) be a Cauchy sequence. For all e > 0, there exists a (t n ) 
such that (s n ) ~ (t n ) and \t n — t m \ < e for all n,m.. 
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Proof. 3 N s.t. |s n — s m \ < e \/n,m > N. Then, fix: 

Li — Sjv 5 ^2 $n j • ■ • 5 tn— i ^ n ? and t n — s n \/n ^ V . 

It is obvious that [(i n )] = [(s„)]. □ 


So, because [(s n )] m is Cauchy, we can suppose: 

(**) | S n m ^ V k , m 

m 

Now, set the aforementioned t n = s„ jrl . Now, all that remains for us to do is to 
show that [(s n )] m —> [(f„)] as in — > oo. 

First, we will deal with the fact that [(f n )] must be Cauchy. We want to compare 
| t n — t m |, or |s n>ra — | . Let e > 0 be given, where in this case e£ Q. Choose an 

N > \ s.t. |[(sn)]m-[(s n )] fe | < e Vm, k > N. Also, chooseap s.t. |s Pjm -s P)fc | < e. 
Now, suppose m, k > N. 

| tm tk | = | Sm,m A | Sm.m S P)m | J* |s p ,m a p ,fc| 3~ A 3c 

where the first term is bounded by (**), the second term is bounded by the choice 
of N and the Cauchiness of ([(s„)] m ), and the third term is also bounded by (**). 
Therefore, we are done, and [(f„)] G F. 

Now, we only need to show that lim m _ > , 00 [(s n )] m = [(f n )], or in other words that 
Ve > 0 3N s.t. m > N => |[(s„)] m — [(f n )]| < e. Note that it is less than or equal to 
e because of the second implication in the definition of “less than” above. Let e > 0 
be given. By the Cauchiness of (t n ), we have 3N > | s.t. Vm,n > N, \t n — t m \ < §. 
Then, we obtain: 


| t n - 


— Sn 


l^ri I T 


— \Sn,n $ 




— S' 


e 

n,m | ^ 7 ) 


= e 


Where the first term is bounded by the Cauchiness of ( t n ) and the second is bounded 
by (**)• Therefore, \(t n ) - [(s„)] m | < e. 

Thus, since every Cauchy sequence in F converges and F is Archimedean, F is 
complete! □ 


8.4. Metric Spaces. 

Definition. A metric space is a set X together with a function d: X x I -) I, 
known as a metric , where d(x , y ) satisfies: 

(1) d(x,y) > 0 and d(x, y) — 0 •<=>■ x = y, 

(2) d(x,y) =d(y,x), and 

(3) d(x, y) < d(x, z ) + d(z, y ) Mx, y,z G X. 

Basically, all we are given when talking about metric spaces is a notion of distance. 


Example: In R, a possible metric is d(x, y) = |a; — y |. 


Example: Take any X, and define d such that: 


d(x,y) 


0, if x = y; 

1, if x ± y. 


This is known as the discrete metric. 
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9. 02/15/11: Metric Spaces, Part One 

9.1. Metric Spaces on R". 

Definition. A metric space is a set X and a function d: X x X — >■ R such that: 

(1) d(x,y) > 0 and d(x,y ) = 0 x = y, 

(2) d(x,y) = d(y,x), and 

(3) d(x, y) < d{x, z) + d(z, y) 

Remember that some examples are \x — y\ on R and the discrete metric from last 
lecture. 

Now consider R” = {(xi,x 2 , ■ ■ ■ ,x n )\xi G R}. We will give this set several 
different metrics. 

9.1.1. The Euclidian Metric. This metric is defined by: 

d((xi, . . -,x n ), (yi, . . .,y n )) = \J {xi - yi) 2 + ( x 2 - y 2 ) 2 H \-{x n - y n ) 2 

For this metric, (1) and (2) are obvious. We will come back to (3). 


We will now explore the concept of norms, with the intention of obtaining some 
new metrics for R™ during this exploration. 

Definition. A Norm on a (real) vector space V is a function || • || : V — > R such 
that: 

(i) ||u|| > 0 and ||u|| =0 v = 0, 

(ii) ||Au|| = | A | ||u|| for A £ R, and 

(iii) ||u + ui|| < | |u| | T ||w||. 

9.1.2. The “Maximum” Norm. We will define this norm such that for V = R n : 


HOzh, • • • ,a: n )|| 00 = max{|ari|, |x 2 |, . . . , |x n |} 

(i) and (ii) are obvious. For (iii), use the triangle inequality on R. 

9.1.3. The “Sum” Norm. We will define this norm such that for V = R n : 

n 

I |(a;i, . . • , Xn)\ = 'y ( I*i| 

i—1 

(i), (ii), and (iii) are all trivial for this norm. 


Norms can also come from inner products (sometimes known as scalar products), 
which we will further investigate. 

Definition. An inner product is a function (•, •) : V x V — »• R such that: 

(a) (v,v) > 0 and (v,v) = 0 v = 0, 

(b) (v,w) = (w,v), and 

(c) {v + w,x) = ( v , x) + (w, x) and (x, v + w) = (x, v) + (x, w) . 
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9.1.4. The “Squaring” Norm. We will define this norm in terms of an inner product, 
such that for V = 


This norm has been defined from an inner product, where ^"=i x i = ( v > v ) f° r 
v = (xi,X 2 , • • • , x n ). While properties (i) and (ii) are immediate from the properties 
of an inner product, we must still verify (iii) for this norm. In other words, we must 
show that: 


(*) 


\v + w\\ 2 < imi 2 + |M 


However, because both terms are positive, showing that the inequality holds when 
both sides are squared is equivalent to showing that it holds as presented in (*). 
Therefore, we have, by (c) (also known as bilinearity),: 


\v + w\f 2 < |H |2 + 2||v| 


w 


(v + w, v + w) < 


I 2 + 2 IMI 2 


w 


{v,v)+2 (v,w) + (w,w) < |H| 2 + 2||t;|| 2 |H| 2 + |MI 2 => 

I (v,w) | < ||«|| 2 |HI 2 

Note that the absolute value signs in the last inequality are valid because if it is 
true without the absolute value signs, then it is true with them. This last inequality 
is known as the Cauchy-Schwarz inequality, which is equivalent to: 

IS 

So now, to show that || ■ || 2 is a norm, we will prove Cauchy-Schwarz. 

Proof. Take v, w € V. Consider (v + Xw , v + A w) > 0, A G K. 

(v + Xw, v + Xw) > 0 => 

(v, v) + 2A (v, w) + A 2 (w, w) => 


|u|| 2 + 2A (v,w) + X 2 ||w|| 2 > 0 


A ||w|| 2 + 


(v, w) 


(v,wY 


> 0 


Because this is true for all A, we can choose A so that the first term is 0. Then, we 
obtain: 

\2 


\V o - 


(v, w) 


> 0 : 


Ml2 IMl2 > ( V ’ W ) 2 


(v,w) I < ll^lla \\w\ 


□ 


Therefore, since we have established the Cauchy-Schwarz inequality, 


is a norm. 


The point of all of this norm-taking was that given a norm, we can make it a 
metric on K” by d(v,w ) = ||u — tu||. For instance, || • || 2 is exactly the same as the 
aforementioned Euclidian metric on R"! 
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9.2. Metric Space Concepts. Let (V, d) be a metric space. 

Definition. The open ball centered at a of radius r for r>0,a£l is: 

B(a, r) = {x £ X \ d(a, x ) < r} 

Example: In R, the open ball is denoted (a — r,a + r). In the discrete metric, the 
balls are either the single point or the whole space. In R 2 , || • || 2 , B(a,r ) is the 
open circle of radius r around a. With || • H^, B{ 0, 1) is the square length 2 around 
O. With || • Ij, B( 0, 1) is the interior of the diamond created by taking the line 
x + y = 1 and reflecting it across all of the axes. B(0, 1) is known as the unit ball. 

Definition. Given a sequence (x n ) and an x £ X, (x n ) converges to x if: 

(Ve > 0)(3 N £ N) s.t. d(x n ,x) < e Vn > N 
Definition. Given a sequence (x n ) and an x £ X, (x n ) is Cauchy if: 

(Ve > 0)(3 N £ N) s.t. n,m > N => d(x n ,x m ) < e 
Definition. ( X , d) is complete if and only if every Cauchy sequence converges. 

Note: Convergence in K n (with any of the norms defined above) is componentwise 
convergence. So, is R” complete in its three metrics? Yes! The discrete metric is 
also complete. 

Definition. A subset U C X is open if: 

\/x £ U 3r > 0 s.t. B(x,r ) C U 
Proposition. B(a,r) is open. 

Proof. Let x £ B(a,r) be given. Then, r > d(a,x), so r — d(a, x) > 0. 

We will claim that B(x,r — d(a,x)) C B{a,r). Suppose y £ B(x,r — d(a,x)). 
Then, we know that d(x, y) < r — d(a, x) => d(a, x) + d(x, y ) < r. So, by the 
triangle inequality, d(a,y) < r. Therefore, for any y € B(x,r — d(a,x)), y is in 
B(a,r). Therefore, B{x,r — d(a,x )) C B(a,r), and B{a,r) is open. □ 

As another example, every subset of the discrete metric is open. 

Definition. A subset E C X is closed if and only if X \ E is open. 

Note that closed does not mean not open! 

Example: In the discrete metric, every subset is both open and closed. 
Proposition. E C X is closed if and only if ( x n £ E)(x n — > x) => x £ E. 

Proof. We will go in both directions. 

(=>) Assume X \ E is open. Also, suppose (x n ) £ E and x n — > x, and 
toward contradiction, that x (ji E, or x £ X \ E. This implies that 
3r > 0 s.t. B(x,r) C X \E. But since x n — > x, d(x n ,x) < r for some 
n. Then, x n £ B(x, r) C X \ E, so x n £ (X \ E) (~l (E), which is a contra- 
diction. 

(4=) Toward contradiction, suppose X \ E is not open. Then, 3 x £ X \ E such 
that B(x, (~l E ^ 0 Vn. This means that for every n £ N, there exists 
some y n £ E such that d(y n ,x) < Thus, consider the sequence of y n s, 
which we will call (y n ). (y n ) then obviously converges to x, but then by 
assumption and hypothesis, x £ (X\E) C I (E), which is a contradiction. 

□ 
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10. 02/17/11: Metric Spaces, Part Two 

10.1. Review. 


Given (V, d),U C X is open if \/x € U 3r > 0 s.t. B{x , r) C U* . If U- h where i £ I 
is open for all i, then (J ieI Ui is open. 

E C X is closed if X\E is open/ If Ei is closed for i € I, then n, e / E i is closed. 

10.2. More Metric Space Concepts. 

Definition. For x £ X , a neighborhood of x is a set SCI such that there exists 
an open set U C X with x £ U C S. 

Definition. The closure of E is: 

®= n f 

F closed, EC.F 

Observe that E is closed. This is the smallest closed set that contains E. Note 
that B(a,r) is not necessarily C(a,r ) = {x G X \ d(a,x) < r}; for instance, this is 
not true in the discrete metric space. 

Note that subsets can be both open and closed! For example, define a metric 
space where X = [—1, 1] U (5, 17). Then, each interval is an open and closed subset 
of the space. Another example is if X = Q, then (— %/2, y/2) is open and closed. 

Definition. The interior of S C X is S = {s £ S \ 3r > 0 s.t. B(s,r) C 5}, or 
{s £ S | S is a neighborhood of S'}. 

Definition. The boundary of S is dS = S\S. 

10.3. The p-adic Metric. 

We will define a metric on Z based on any p for p prime. We will call this a p-adic 
metric. 

Define a metric by a norm, \j\ p . Write j = p r ■ m such that (m,p) = 1. Let 
1 0 |p = 0 and \j\ p = 2~ r where 2 can be any prime. 

Then it is the case that 

|j|p > 0 and j = 0 |j| p = 0 


as well as that 

\i+j\ P < max{|i| p , |j| p } < \i\ p + \j\ p . 

Furthermore, d p (i,j ) = \i — j\ p , and this metric makes Z into a metric space. Note 
that, for instance, for p = 3, 3" — > 0. 


*Note that the empty set is open. 
^Note that the empty set is closed. 
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Example: 

(1 - 3)(1 + 3 + 3 2 + • • • + 3 n ) = 1 - 3" +1 -> 1 
Therefore, 2 + 2 • 3 + 2 • 3 2 + • • • + 2 • 3" + • • • = -1. 

We can also define | • | p on Q, where q = p r ■ ^ for ( m,p ) = 1, (n,p) = 1. Then, 
\q\ p = c 2r r and d p (q 1 ,q 2 ) = \qi - q 2 Ip- 

Note that we can write numbers in “decimal” form by writing them as such: 

OO OO 

x = ^2 ai ■ p l + *22 di ■ p~ l := . . . a 3 a 2 ai ,did 2 d 3 . . . 

*= i j = i 

Then, we get a “decimal” where as you add terms to the left it converges and as 
you add to the right it diverges! 

We can define a field with this metric by defining it like we did R, but with this 
new metric instead of the familiar one for R. This held is called the p-adic numbers. 
Note that this technique of completing a metric space (as we did when constructing 
R from Q) can be applied to any metric. 

10.4. Even More Metric Space Concepts. 

Definition. Let (X, d) a metric space and S C X. Then, x £ X is called an 
accumulation point (or limit point or cluster point) of S if every neighborhood 
of x contains a point in S other than x. 

Note that E C X is closed if and only if it contains all of its accumulation points. 

Definition. Let (X, d) be given, and consider T := {U \ U open in X}. This col- 
lection of subsets is called a topology on X defined by d. A topology satisfies three 
axioms: 

(1) 0 € T, X € T. 

(2) If Ui € T, then i £ I => U< e j G T. 

(3) For Ui, U 2 , ■ ■ ■ , U n G T, it is the case that HiLi G T. 

Any property that can be expressed only using T, or open sets, is called a topo- 
logical property. For instance, we can say... 

Proposition. Convergence is a topological property, or in other words: 

lim x n = x **=> MU open in X and x G U, 3 N s.t. n> N => x n G U. 

n—too 

Proof. We will go in both directions. 

(=>) Let U be open with x GU given. Since U is open, 3r > 0 s.t. B{x,r ) C U. 

Therefore, 3N s.t. n> N => d(x n ,x) < r => x n G B(x,r) C U. 

(<=) Let e > 0 be given. We know that B{x, e) is open. Thus, 3N s.t. n > N => 
x n G B(x,e) => d(x n ,x) < e. 

□ 

Therefore, changing the metric does not change the notion of convergence on a given 
topology. Note that Caucliiness and completeness are not topological properties, 
but closures and interiors are. 

Definition. Let U,V be open subsets of X. A topological space X is Hausdorff 
if given that x G U , y G V , and x y, then U D V = 0. 
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11. 02/24/11: Continuity and Cardinality, Part One 
11.1. More About Metric Spaces. 

Proposition, x £ E •£=> (Ve > 0) B(x, e) fl E ^ 0. 

Proof. We will go in both directions. 

(=>) We will proceed by contradiction. Suppose there exists an e > 0 such 
that B(x,e) fl E = 0. Then, X \ B(x,e) is a closed set containing E. By 
the definition of a closure, this implies x £ E C X \ B(x,e). This is a 
contradiction because x £ B(x,e). 

(<=) Let F be closed and E C F. Suppose x ^ F. Then there exists an e > 0 
such that B(x,e) C X \ F. Because ECF,X\FCX\E. This is a 
contradiction, so for x £ F and MF where F is closed, E C F => x £ E. 

□ 

Definition. Given (X,d) and A, B C X, we say that A is dense in B if B C A. 

Note that A x n B — A B fl B (where A x is the closure of A under X and A B is the 
closure of A under B), by the e-criteria for x £ E. 


11.2. Continuity. 


Definition (e-S). Given metric spaces (X,d) and (Y,D), a function f : X — ► Y is 
said to be continuous at x if 

(Ve > 0) (3<5 > 0) s.t. d(x, y) < S => D(f(x),f{y)) < e . 


Note that this is continuity at a single pointl 
Example: / : R — > R. such that 


/O) 


0, if x £ Q; 
x, otherwise. 


This is a function which is continuous at 0 and discontinuous anywhere else. 


Proposition. / is continuous at x £ X (x n — > x) => (f(x n ) —> f(x)). 

Note: This is known as the limit definition of continuity at a point. 


Proof. We will go in both directions. 

(=>) Suppose x n — > x and let e > 0 be given. Choose a <5 such that 
d(x,t) < 6 => d(f(x),f(t)) < e. 

Using 6 in the definition of x n x, get an N s.t. Vn > N, d(x n ,x) < 6. 
This implies that d(f(x n ),f(x)) < e. 

(<=) Suppose / is not continuous at x £ X. This means that: 

3e > 0 s.t. VS >0,3 1 £ B(x,S) s.t. d(f(t),f(x)) > e. 

Choose a sequence x n £ B{x, -) with d(f(x n ),f(x)) > e. Then, we have a 
contradiction, as x n —> x but f(x n ) f{x). 

a 
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Note that this has become the commonly accepted definition of continuity. However, 
this is because of the shift in focus from topological spaces to metric spaces (a 
reversal of a previous trend). In a general topological space, the limit definition of 
continuity does not hold! 

Definition. Given metric spaces X, Y and f:X—>Y,f is continuous if f is 
continuous at every point of X* 

Proposition. / : X — >• Y is continuous / -1 (£/) is open for all open U C Yd 
Proof. We will go in both directions. 

(=>) Let U be open in Y . Take x € / _1 (i 7 ). This implies that f(x) € U. By the 
definition of continuity, 3B(x,S) s.t. f(B(x,6)) C U, so B(x,S) C f~ 1 (U). 
(<=) Take x € X and let e > 0 be given. We must show that 

3<5 > 0 s.t. f(B(x, 5)) C B(f(x),e) . 

However, B(f(x), e) is open, so f~ 1 (B(f(x),e)) is open by hypothesis. Also, 
x € f~ 1 (B(f(x),e)), so > 0 such that B(x,S) C f~ 1 (B(f(x),e)), which 
implies that f(B(x,S)) C B(f(x),e). 

a 

Definition. (X, d) and (Y, D) are isometric if there exists a bijection f : X — >■ Y 
with D(f(x),f(y)) = d(x,y). This implies that f is also an isometry. 

Definition. /: X — > Y is called a homeomorphism if f is a continuous bijection 
whose inverse is continuous. 

Note: The last condition is necessary! For instance, the identity function from 
(R, discrete) to (R, usual) is continuous but / -1 is not. 

11.3. Countability and Cardinality. 

We will take a little detour from metric spaces in order to talk about Cardinality, 
so as to prepare for the guest lecture in two lectures from Professor Hugh Woodin. 
First, we will explore the Cantor Set, defined as such: 

So = [0, 1] 



The Cantor set is defined as C := flneN ^ n ' Essentially, we start with [0,1] and 
remove the middle third each time, for every interval. The endpoints of the intervals 
in the set are definitely countable, but the set itself as actually uncountable! 


*The related concept of uniform continuity is defined in a footnote in Lecture 16. 
^Reminder: Given sets A, B and /: A — > B, if: 

S C A, define f(S) = {f(x) \ x £ S}, and 
T C B, define / _1 (T) = {x e S \ f(x) £ T}. 

In this case, /“ 1 is not the inverse of /! / -1 always exists when applied to a set. 
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12. 02/24/11: Cardinality, Part Two 

12.1. The Cantor Set, Continued. 

Recall the Cantor set from last time. Here is an inductive way to define it. 

Take an interval I = [a, b ]. We will define C(I) = {[a, a + ^ 9l ], [a + 2 ^~ a ^ ,£>]}. 
So, given J 0 = {[0, 1]}, we have J n+1 = |J /6J?i C(J). Then, 

c=n<u ')• 

raSN /6Jn 

Proposition. The interior of the Cantor set is empty, or C = 0. 

Proof Sketch. Choose n,e with 3 -n < Then, for some n, x is in an interval of 
width 3~ n , so there is no ball around x. □ 

12.2. Random Facts. 

There exists a continuous nondecreasing function /: [0, 1] —► [0, 1] with /( 0) = 0 
and /( 1) = 1 such that / is constant on [0, 1] \ C. The graph of / is known as the 
Devil’s Staircase. 


Russell’s Paradox. Given a set S, S € S or S </ S. Define A = {.S' | S </ S}. Does 
A belong to A1 There is no way for A to belong to or not belong to itself, as both 
result in contradictions. Thus, Russell’s Paradox will act as a cautionary tale for 
the discussions to come; we must be careful when we’re talking about sets of all 
sets. 

12.3. Cardinality. 

We will denote the cardinality of a set A as |H| (or ff[A)). 

Definition. Given sets A and B, |H| = \B\ if there exists a bijection f : A—>B. 

Definition. A is finite if there exists an n £ N such that |H| = | { 1 , 2, . . . , n}\ . In 
other words, for finite sets, |H| = \B\ <£=> they have the same number of elements. 
A is infinite if it is not finite. 

Definition. A is countable if A is finite or |H| = |N|, or equivalently, you can 
enumerate the elements of A as a sequence. 

Proposition. S C N is countable. 

Proof. Define (c n ) as follows. Define C\ to be the smallest element of S, and define 
Si = S \ {ci}. Then, define c n+ 1 to be the smallest element of S n , and define 
S/-)-! = S n \ {c n }. Then, it is easy to check that {ck \ k € N} = S. □ 

Definition. \A\ < \B\ (also written A^ B) if there exists an injection f:A—*B. 
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Example: If S' C T, then S ^ T . Therefore, this order on sets says that up to a 
change of name, A C B. 

Proposition. A^ B <£=> 3 a surjection g: B — x A. 

Proof. We will go in both directions. 

(=») Given an injection f:A—>B, define / such that for a £ A, g(f(a )) = a 
and for everything else, g(x) = a for some a. 

(<=) We want to find an injection /: A — x B. For each a £ A, choose an x £ B 
with g(x) = a, and define f(a) = x. 

□ 


Proposition. Z, Z x Z, and Q are countable. 

Proof. We will prove them one at a time. 

(1) Z: We will arrange the elements of Z in a sequence, namely (c„) such that 
Co = 0, C 2 n -i = n, C 2 n = —n for all n £ N. 

(2) Z x Z: By the previous argument, jZj = |N|, so it suffices to show that 
N x N is countable. We will arrange the elements of N x N as such: 


(1,1) 

(1,2) 

(1,3) 

(1,4) 

(2,1) 

(2,2) 

(2,3) 

(2,3) 

(3,1) 

(3,2) 

(3,3) 

(3,4) 


Now, proceed down each diagonal, starting at (1,1), then moving to the 
next diagonal containing (1,2) and (2, 1), then the next, containing (1,3), 
(2,2), (3, 1), and so on. Alternately, define a function /:NxN-yR such 
that /((m,n)) = 2 m 3 n . By the unique prime factorization of integers, this 
is certainly an injection. 

(3) Q: Take the function /: Z x N — X Q such that /((m,n)) = This is 
clearly a surjection. 


12.4. Counting R. 

We will define 2 N = {sequences (a n ) such that a n £ {0, 1}}, such as 01101001 . . . 
Note that this is the same as the set of all subsets of N, and in general, 2 A is the 
same as subsets of A , also known as the power set of A. 

Theorem (Cantor). 2 N is uncountable. 

Proof. Suppose it is countable. Then, we can enumerate them as such: 


(&n. 

h = 

01,1 

«2,1 

03,1 


h = 

«1,2 

02,2 

°3,2 

( a n. 

>3 = 

a 1,3 

«2,3 

03,3 
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Construct b n = a n ^ m + 1 (mod 2). Obviously, b n is in 2 N , but it cannot be the nth 
term in the sequence of sequences because it differs from the nth term in the nth 
place. Therefore, it is not in the list, and we have a contradiction. □ 

Corollary. R is uncountable. 

Proof. It suffices to define an injection /: 2 N — * R. Let /((a„)) = a n 10~ n *. 

We will claim that / is an injection. The proof is in the lecture notes on Cardinality, 
page 2. □ 

There is another proof in the notes, page 3, which shows that R has cardinality no 
less than |2 N |. 

Theorem (Schroeder-Berinstein). If \A\ < \B\ and \B\ < \A\, then |A| = \B\. 

Proof. Next lecture. □ 

By the remark after the Corollary and this Theorem, we can see that |R| = |2 N |. 

The Continuum Hypothesis asks whether there is a subset of R that is uncount- 
able but that does not have the same cardinality as 2 N . Or in other words, if there 
exists a set A such that |N| < \A\ < |2 N |. The answer is still not known. 


*Note that series are not defined yet. However, partial sums are Cauchy sequences, so they are 
reals. 


28 



Math 104, Spring 2011 Vaughan Jones 


Lecture 13 


13. 03/01/11: Set Theory: Guest Lecture by Hugh Woodin 

13.1. Schroeder-Bernstein. 

Two prominent set theorists were Cantor and Godel, both of whom went insane. 
Anyway... 

Definition. Two sets X, Y have the same cardinality if there exists a bijection 
n: X — » Y. We denote this as \X\ = |F|. 

Caution: This definition is not as intuitive as it seems. If X is infinite and a € X, 
then it can happen that X and X \ {a} have the same cardinality. 

Definition. Suppose X,Y are sets. Then, the cardinality of X is less than or equal 
to the cardinality of Y if there exists an injection n: X — > Y. We denote this as 

1*1 < in 

Now, wc will turn our attention to the Schroeder-Bernstein Theorem. 

Theorem (Schroeder-Bernstein). Let X,Y be sets and suppose \X\ < |F| and 
|V| < |X|. Then, |A| = |V|. In other words, suppose X, Y are sets and there exists 
injections f : X — > V and g: Y — > X. Then, there exists a bijection n: X — > Y . 

Before proving the theorem, we will first develop some concepts and properties 
that will help us along the way. 

Consider a set Z and an injection h: Z — >• Z. Start with some point a £ Z, and 
keep applying h to it. Then, one of three things will happen: 

(1) We will get into a loop, so h n (a) = a for some n £ N. 

(2) We will reach a point where h~ n (a) is not in the range of h, so we cannot 
’’back up” any farther, and effectively, the chain starts at a certain point. 

(3) We will never cycle, but we will be able to ’’back up” endlessly, so for all 
n £ N, h~ n (a) is in the range of h. 

Notice that case 3 is just a degenerate case of case 1, as it is simply just an endless 
loop backwards. Now, we will define a concept using this intuition. 

Definition. Suppose h: Z Z is injective and suppose a £ Z. Then the orbit of 
a given by h is the subset of Z generated by a , h, h where h ~ l : {range of /;.} — > Z . 
More formally, define Xq = {a}. Then, define inductively: 

x n +\ = {h(b) | b £ X n { U {c £ Z | h(c) £ X n { U X n 
Then, the orbit of a given by h, denoted Z a , is defined to be {J{{L 0 X n where n € N. 

Example: X\ = {a, h(a)} U {c} where h(c) = a if such a c exists. Furthermore, 
A 2 = X\ U { h(h(a))} U {d} where h{d) = c if c existed and if d exists. 

Example: Let Z = {0, 1, 2, . . . }, and let h(n) = n 2 for n £ Z. Then, Z 0 = {0}, 
Z\ = {1}, and Zi = {2,4, 16, 256, . . . }, or in other words the even powers of 2. Zj, 
can also be seen as the even powers of 3. 

Note that we can also denote the orbit of a given by h as Z% in order to explicitly 
state the injection that we are dealing with. 

Lemma 1. Suppose h: Z — » Z is injective and suppose a,b £ Z. Let Z{f and Zj’ 
be the orbits of a and b relative to h, as defined above. Also, suppose n / 0. 
Then, Zjf = Zjf. 
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Proof. Exercise. 

Another intuitive definition follows from our examination of orbits above. 


□ 


Definition. Suppose h: Z — » Z is injective and suppose a £ Z . Let Z'f be the orbit 
of a given by h. has an eve-point if there exists a b in Z% such that b is not 
in the range of h. 

Lemma 2. If an orbit has an eve-point, then the eve-point of that orbit is unique. 

Proof. Exercise. □ 

Lemma 3. Let h: Z — ► Z be injective and a £ Z. Suppose Z*f has no eve-point. 
Then, h\ Z h: Zjf — > Zf is a surjection, and hence a bijection. 

Proof. Exercise. □ 


Now, we are ready for the actual proof. 


Proof (Schroeder- Bernstein) . We are given injections /: X — > Y and g: Y — > X. 
We need to construct a bijection II: X — > Y. Consider the functions go f: X — » X 
and / o g : Y — > Y . These are both injections because the composition of two 
injections is also always injective. So now, we can consider the orbits of points in X 
given by go f and the orbits of points in Y given by fog. We will define II: X — >■ Y 
by defining II | YS o / for each orbit of X given by go f . There are two cases for each 
orbit: 

(1) X-j°f has no eve-point. Then, for each b £ Xj>°f , 11(6) = /(6). 

(2) X9°f has an eve-point. Let ao be the eve-point. Then, it follows that 

must also have an eve-point. Let bo be the eve-point of Y^°®, and define 
II(ao) = bo, II(ai) = 6i, and so on. 

We can see that every point of every orbit is hit exactly once by II, and thus II is 
a bijection from V to Y. □ 

This theorem proves the rather trivial- looking statement that if |V| < |V| and 
\Y\ < \X\, then |V| = |Yj. However, while it may look trivial, it really is not. 

Proposition. |M| = |P(N)|, where P(N) = {A \ A C N}. 


Proof. It suffices to show that |R| < |P(N)| and |P(N)| < |R|. 

(1) Clearly, there is a bijection n: N — > Q, so we just need an injection /: R — ► 
P(Q). Define f(r) := {q\q £ Q ,q < r} for all r £ R. This is clearly 
injective, so JR| < |P(Q)| = |P(N)|. 

(2) We need an injection g: P(N) — > R. Define g(a), where a £ P(N), as such: 


ff(a ) 


E i ea(ra) i if « 7^ 0 
0 if a = 0 


This is clearly injective, so |P(N)| < |R|. 


□ 


Theorem (Generalized Cantor). Suppose X is a set. Then, |X| ^ |P(V)|, where 
P(X) = {A\ A C X}*. 


‘Note that this implies |X| < |P(X)| and |R| = |P(N)| + |N|. 
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Proof. Suppose /: X — ► P(X). We need to produce an A C X such that A is not 
in the range of /. Define A = {a £ X\a £ /(a)}. Then, A cannot be in the range 
of /. To see this, suppose A = f(b). Then, we have: 

b G A <=> b(£ f{b) -4=> b ^ A 

which is clearly a contradiction. □ 

This theorem implies that there are an infinite number of infinities, each one bigger 
than some others. 

Therefore, we will say Ho = |N|. Where does |P(N)| = |R| fit in? Is it Hi? 

The Continuum Hypothesis states that |R| = Hj. We have gotten to the point 
where we know that given our standard axioms, we can build universes where this 
is true and universes where this is false. For another illustration of a conjecture like 
this, consider the Parallel Postulate. It is true in R 2 , but false in a universe that 
is a circle without the edge, despite that the usual axioms of geometry hold in this 
new space. 

In recent times, we’ve gotten closer to an answer. Behind this question and a lot 
of other set theory lie many philosophical issues about the meaning of things that 
don’t exist... 
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14. 03/03/11: Compactness, Part One 

14.1. Basic Concepts. 

Let A C X, and let (X, d) be a metric space. 

Definition. An open cover of A is a family {U a \ a £ 1} of open subsets of X 
such that A C (J 7 U a . 

Example: [0, 1] C R. Then, {(—1, 2)} is an open cover, {(x — e, x + e) \ x € [0, 1]} 
is also an open cover. Consider e = |. Then, the cover is very redundant, as it is 
an uncountably large collection of intervals, and we could come up with something 
more economical. 

Definition. If {U a \ a & 1} is an open cover of A, a subcover is a subfamily 
{U a | a € J}, where J C I, that is also an open cover of A. 

Definition. A C X is compact if for every open cover , there is a finite subcover. 

It is the case that A C X is compact if and only if A C A with the inherited 
metric is compact. Therefore, the notion of compactness is an inherited notion, like 
closedness. Note that this is a very difficult definition to work with, if we want to 
show a set is compact. However, this does make it very easy to show that a set is 
not compact. 

Example: Finite metric spaces are always compact for any AC- X. 

Example: Take R. {(x — e, x + e) \ x £ R} is an open cover of R. Furthermore, you 
cannot cover R with finitely many intervals, so R is not compact. Another example 
is, for Z, the open cover {(n — |, n + |)}. 

14.2. Basic Properties. 

Proposition. In any metric space, a compact subset is closed and bounded*. 

Proof. We will prove the two points separately. 

(1) First, we will prove boundedness. Take x £ A. Consider {B(x,?i) | n £ N}. 
This family of sets is trivially an open cover, even of all of X. Take a finite 
subcover {B(x, m, . . . , B(x, n max )}. Then, [JiLT B ( x > n i) = B ( x i n max)- 
A C (J™// B(x, Hi) because it’s an open subcover, so A C B(x,?r max ) and 
A is bounded. 

(2) Now, we will prove closedness. Let x £ X \ A, and define: 

U n = X \ {y | d{x, y) < ± where n £ N} . 

We will claim that the U n s cover A, or that every a £ A is in the complement 
of some {y\d(x,y) < -/}. In other words, for some n, d(a,x) > or 
n > x ) ■ This is clearly true by the Archimedean property of R, so our 
claim is true. Now, extract a finite subcover {U 1 ,U 2 , ■ ■ ■ , U m}- Notice that 
U^fu Ui = Um , so A C Um- Then, we know that: 

{y I d(x, y) < C X \ A C U M 

so it follows that B(x, jj) C X \ A. Thus, because x was arbitrary, there 
is an open ball around every point in X \ A, and A is closed. 


*A subset SCI is bounded if there exists ana 6 I and an R > 0 such that S C B(a, R ). 
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□ 

Proposition. If (X, d) is a compact metric space, then any closed subset of X is 
compact. 

Proof. Let A be closed, and let U a e/ U a be an open cover of A. It is clear that 
{U a | a € 1} U { X \ A} is an open cover of X. By the compactness of X, we know 
that X must then also be covered by U^sn UX\4, for some N G N. Then, it is 
clear that a finite subcover of A, because X \ A cannot cover anything 

in A. □ 

14.3. Sequential Compactness. 

Definition. Given (X,d) and A C X, A is sequentially compact if every se- 
quence in A has a convergent subsequence in A. 

Example: By the Bolzano- Weierstrass Theorem, every closed interval [a, 6] is se- 
quentially compact. Furthermore, by extension, [ai, 6 i] x [ 02 , 62 ] x ••• x [a n , 6 „] is 
sequentially compact in R”. To see this in R , first get a convergent subsequence 
in the first coordinate, which we can do because if we consider just the sequence 
(a„), it is a sequence in R. Then, fix that subsequence and get a convergent sub- 
subsequence in the second coordinate. Any subsequence of a convergent sequence 
converges, so both coordinates converge and we have a convergent subsequence in 
R 2 . This process can easily be generalized to any n. 

Recall that when we defined compactness, we said that the definition was very 
hard to work with. This definition is much easier, so we would like for them to be 
equivalent. Lucky for us, they are! 

Theorem. Let (X, d) be a metric space. Then, X is compact if and only if X is 
sequentially compact. 

Proof. In the next lecture. □ 


33 



Math 104, Spring 2011 Vaughan Jones 


Lecture 15 


15. 03/08/11: Compactness, Part Two 

15.1. (Sequential) Compactness. 

Remember: E C X is compact if every open cover of E has a finite subcover, and 
E C X is sequentially compact if every sequence in E has a convergent subsequence 
in E. 

Theorem. Given a metric space (X, d), X is compact if and only if X is sequen- 
tially compact.* 

Proof. We will go in both directions. 

(=>) Let ( x n ) be a sequence in X. If {x n \ n € N} is finite, then some x n must 
be hit infinitely many times, so we would be done. Therefore, assume 
{xn\ is infinite. Let x £ X. Either x is the limit point of a subsequence 
of ( x n ), or there exists an r > 0 such that | B(x,r) (~l {x n \ n € N}| < 1. 
To see this, assume that the latter is not true for some x £ X. Then, 
for all r > 0, \B(x,r) (~l {x n \n € N}| > 1. In this case, we could take 
ever-decreasing values of r, and there would be at least one x n such that 
d(x,x n ) < r for every r > 0. Therefore, if you picked all of those terms, 
we would have a convergent subsequence of (x n ). So, in other words, there 
is a convergent subsequence of (x n ) or \J xeX B(x,r) forms an open cover 
for X. By compactness, we can obtain a finite subcover of this open cover, 
so only finitely many B(x,r) cover X, and hence {x„}. Then, because for 
every x, \B(x,r) PI {x„ \ n £ N}| < 1, the finiteness of this subcover would 
imply that {x n } was also finite, which is a contradiction. 

(<=) Let {U a } be an open cover of X. 

First, we will prove this statement: 

3R > 0 s.t. \/x £ X, 3U a s.t. B(x, R) C U a . 

Proceeding by contradiction, we will assume that no such R exists. Because 
no such R exists, in particular, for each n £ N, there exists an x n £ X such 
that B(x n , d ) (/ U a for any U a . Now, because X is sequentially compact, 
we can get a convergent subsequence of this sequence which converges to 
some x £ X, which we will denote (x nk ) — > x. We know that this x £ U a 
for some U a , and because U a is open, there exists an r > 0 such that 
B(x,r) C U a . Then, by the convergence of ( x„ k ), there is some N £ N 
such that for all n > N, the following are true: 

(!) s < §> and 
(2) x n £ B(x,r). 

However, by (2), we have that B(x n , |) C B{x,r ) C U a , so in turn, by (1), 
we have that B(x n , ^) C U a , which contradicts that we can find x n £ X 
such that B(x n , -) ^ U a , which means that our initial assumption that 
such R does not exist was false. Therefore, our initial statement is trued 
Now, we will show that finitely many balls of radius R (as defined above) 
cover X. It is sufficient to show this because each ball is then contained 
in some U a , so then we know that finitely many U a cover X, and we will 

*Note that both of these are topological properties, but this theorem is not true in a general 
topological space. 

+This is a result that is of independent interest, because it proves the existence of Lebesgue 
numbers. 
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have extracted a finite subcover of a general open cover of X. We will 
proceed by contradiction, and assume that it is not the case that finitely 
many balls of radius R cover X 1 and that it is impossible to generate a 
finite subcover. Then, we will construct a sequence (x n ) as such. First, 
simply pick an £ X. B(x\, R) does not cover V, so we can pick a point 
X 2 outside B(xi,R) such that d{x 1,2:2) > ^ . Then, pick another point X 3 
outside of B(xi, R)UB(x 2 , R) such that d(xi, X3) > ^ for i = 1, 2. Continue 
this process, such that x n+ \ is not in (J" =1 B( x i,R) and d(xi,x n+ 1) > ^ 
for i = 1,2, ... ,n, for all n £ N. Then, the latter statement is obviously 
true for all subsequences of (x n ). Therefore, this sequence cannot have any 
convergent subsequences, a contradiction of our initial assumption. Thus, 
it must be the case that finitely many balls of radius R cover X, so X must 
be compact. 

□ 

Theorem (Heine-Borel). A subset ofW 1 is compact if and only if it is closed and 
bounded. 

Proof. We will proceed in both directions. 

(=>) We already proved this statement for an arbitrary metric in the last lecture. 

(<=) Let A C R™ be closed and bounded. By the boundedness of A, we know 
that A C B(0,R + 1) for some R > 0. Then, it is clearly the case that 
A C [-R, i?] x [-R, f?] x • • • x [-R, i?]. The right hand side of that expression 
is sequentially compact (from last lecture) and hence compact (from this 
lecture), and we also proved last time that a closed subset of a compact set 
is also compact. Therefore, A is compact. 

□ 

From this theorem, we obtain some very useful results, such as that the Cantor set 
is compact, the unit sphere is compact, and so on. 

Now, we will build up to another major, but seemingly unrelated, result. 


15.2. The Equivalence of Norms on R". 

Proposition. Let X , Y be metric spaces such that X is compact. Then, given a 
continuous function f:X—*Y, f(X) is compact. 

Proof. Let U a be an open cover of f(X). Then, it is clear that f~ 1 {U a ) covers X. 
Because / is continuous, we know that for any open set U C Y , / _1 (C I) is also an 
open set. Thus, f~ 1 [U a ) is an open cover of X, and by the compactness of X, for 
some n £ N, we have that: 

n 

xc\Jf~\u ai ) 

i= 1 

This, in turn, implies that f(X) C |J" =1 U ai , so f{X) is compact. □ 

Proposition. Let X be a metric space. If X is compact, then any continuous 
function f : X — > R attains its minimum and maximum values. 
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Proof. From the proposition above, we know that f{X) C R must be compact, so 
it is therefore closed and bounded. Thus, sup f{X) and inf f(X) exist, and by the 
closedness of f(X), must lie inside f{X) itself. □ 

Corollary. Let X be a compact metric space. Then, given a continuous function 
f : X — ► R such that f(x) > 0 for all x £ X, it is the case that there exists an e > 0 
such that f(x) > e for all x £ X . 

Proof. This follows immediately from the above proposition. □ 

Theorem. Any two norms on R™ are equivalent, or in other words, given two 
norms \ ■ \ and || • || on R", there exist A, B > 0 such that for all x € R", 

A\x\ < ||x|| < B\x\ . 

Proof. In next lecture. □ 
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16. 03/10/11: Norms, Separability, Connectedness 

16.1. Equivalence of Norms on R”. 

Theorem. Any two norms on R™ are equivalent, or in other words, given two 
norms || • || and ||| • ||| on R n , there exist A,B> 0 such that for all x € R", 

A||a;|| < infill < i?||ar|| . 


Proof. We will make two trivial observations to start. First, note that if we replace 
HI • HI with || • 1 1 2 , we will obtain the same result. Second, the statement is obviously 
true for any A, B if x = 0, so wc will assume that x ^ 0*. 

First, we will prove the first inequality. Let be a unit vector with a 1 in the 
ith place. Then, x = J/” =1 Xiei. Then, we can obtain that 


n 

i = 1 


<E(w • 11*11) < 


i— 1 


\ 


E 

i = 1 


Xi\ 


\ 


Ei 

i = 1 


\ e i\ 


by the triangle inequality, followed by the Cauchy-Schwarz inequality. Furthermore, 
\/]C"= i \ x i\ 2 = IMh, so this implies 




\x\\ < a: 


which proves the first inequality. Observe that this result implies that 1 1 • 1 1 is 
uniformly continuous^ for 1 1 • 1 1 2 , or, in other words, that the identity function from 
(R n , || • ||) to (R”, || • 1 1 2 ) is uniformly continuous (and vice-versa). 

Now, we will prove the second inequality. Let e > 0 be given. Then, choose 
J = Ae, where A is the term we found above. Then, if 1 1 a: — z/| 1 2 < 5, then 

\\x - y\\ < j\\x - y\\ 2 < = ^- = e . 


As noted above, this means that the identity function from (R n , 1 1 - 1 1 2 ) to (R n , || • ||) 
is (uniformly) continuous. In particular, let S n = {a: G R" | ||a:|| 2 = 1}. Then, 
clearly, the identity function from (S n , || • || 2 ) to ( R n , || • ||) is also continuous. We 
know that for any x G S n , ||a;|| 2 = Y^i=i x i = so S n obviously closed and 
bounded, and hence compact, by the Heine-Borel Theorem. Furthermore, || • || is a 
norm, so ||x|| > 0 for all x G S n . By the theorem from last lecture, this means that 
there exists an e > 0 such that ||x|| > e for all x G S n . So, if we take an arbitrary 
v ^ 0 in R", then we have: 


V 

< 

V 



IMh 

2 

IMI 2 


e M 2 


I«ll2< -IN 


completing the proof. 


□ 


*Note that 0, in this case, is the zero vector in R n , not the real number 0. 

^Given metric spaces (X,d) and (Y, D), a function /: X — »■ Y is uniformly continuous if for 
all e > 0, there exists a 5 > 0 such that for all x,y E X , 

d(x,y) < S => D(f(x),f(y)) < e. 

The difference between continuity and uniform continuity is that the S in uniform continuity must 
work for all x, y. 
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Now, we will discuss two final metric space topics before diving into the subject 
of Calculus. 


16.2. Separability. 

Definition. Let (V, d) be a metric space. X is separable* if there exists a count- 
able dense subset of X. 

Example: R. is separable because KCQ and |Q| = |N|. 

Proposition. Every subset of a separable metric space is separable with the inher- 
ited metric. 

Proof. Let (V, d) be a metric space, Q be the countable dense subset of X , and 
A C X. Consider {B(q, | q £ Q,n € N}. This is a countable set, as Q x N is 

countable. For each q,n, if B(q, (~l A ^ 0, choose a point in it, which we will 
denote x q>n . Then, let D = {x q , n \ q £ Q,n £ N}. It is clear that D is countable 
and a subset of A. Therefore, we only need to show that it is dense, or in other 
words, given a £ A and e > 0, that there exists an x £ D such that x € B{a,e). 
Choose anneN such that ^ < f. Because Q is dense in X, there exists a q £ Q 
such that d(q, a) < - < | . This implies that B(q, n A ^ 0, so for some x £ D, 
x £ B(q, i). Therefore, we have: 

d(x, a) < d(x , q) + d(q, a) < — I — < e 

n n 

completing the proof. □ 


The notion of separability might seem a bit random and unrelated, but in the 
words of Professor Jones, “Paradise is a complete separable metric space.” 


16.3. Connectedness. 

Definition. Let (X,d) be a metric space. C C X is connected 11 if for open subsets 
U,V of X: 

CCUUV=>CCU or C C V . 

Note: We define the empty set to be connected. 

Example: All sets which are made up of just one point are obviously connected. 


Proposition. The continuous image of a connected set is connected. 

Proof. Take a continuous function / : X Y, where X , Y are metric spaces. Then, 
we want to show that for a connected subset C of X and open subsets U, V of Y, 

f(C)C.UHV => / (C) C U or /(C) CV. 

Notice that C C / _1 (C) n/ _1 (V). Then, by the connectedness of C, C C / -1 (V) 
or C C / -1 (V). Thus, /(C) C U or /(C) C V, so /(C) is connected. □ 


*This is a topological notion. 
^This is also a topological notion. 
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Remember that for a continuous function, the inverse image of an open set is also 
open. 

Theorem. A subset of R is connected if and only if it is an interval.* 

Proof. We will go in both directions. 

(-4=) Let J C R be an interval. Let U and V be open sets in R, and suppose 
/ C U II V. Now, we will proceed by contradiction and assume I fl U ^ 0 
and I fl V ^ 0. Choose s € / fl U and t £ I n V. Without loss of generality, 
assume s < t. Consider the set {x | [s,x] C U}. This set is clearly bounded 
above by t. Also, s is in the set, because s £ U. Therefore, the supremum 
exists, so we will say a = supjx | [s, x] C U}. Because U is open, if a 
was in the set, it would be the case that (a — e,a + e) C U, and hence 
[s, a+ |] C U. However, a was the supremum of U, so this could not be the 
case, and a ^ U. Similarly, a ^ V, because if it was, then (a — e, a + e) C V, 
which would imply a — | £ V, a contradiction because anything less than 
a must be in U and we assumed that U fl V = 0. Therefore, a ^ U and 
a (fV . However, this creates a contradiction with our initial assumption, 
because [s, t] C I and s < a <t. Thus, any interval in R is connected. 

(=>) Let A C R be connected. We will claim that then, it has the property 
that if s,t £ A where s < t, then [s,f] C A. To see this, assume that this 
is not true, and that for some s < x < t, x ^ A. Then, it is clear that 
A C (—oo, x) U (x, oo), a disjoint union of two open sets. However, we also 
know that s £ (— oo, x) and t £ (x, oo), which is a contradiction because A 
is connected. Therefore, our claim is true, and A must be an interval. 

□ 

Corollary. Let f : [a, b] — > R be a continuous function. Then, f([a,b\) is also a 
closed interval, [c, d] . 

Proof. This follows immediately from the two previous results. □ 

This is a very powerful corollary, as it shows that a continuous function on an 
interval simply stretches, shrinks, and/or shifts the interval! 


* Interval, here, means any sort of interval, namely any one from this list: (a, b), (a, b], [a, 6), 
[a, 6], (—00,6), (—oo,6], (a, oo), [a, oo). 
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17. 03/15/11: More (Path) Connectedness, Series and Convergence 

17.1. More on Connectedness. 

Recall that E C (X,d) is connected if for open subsets U,V of X: 

E CUUV => E CU oy ECV . 

We have already shown that in R, the only connected sets are intervals, as well as 
that the continuous image of a connected subset is connected. Furthermore, note 
that connectedness is an inherited property, like compactness. 

Proposition. Let A , B be connected subsets of X. If A (~l B ^ 0, then A U B is 
connected. 

Proof. Let U, V be open sets in X , and suppose A U B C U II V. Then, AC U UV 
and B C U AV . Without loss of generality, assume A C U. Then, Atl B C U. We 
know that AnB ^ 0, so there exists a b C B such that b CU . By the connectedness 
of B it follows that B CU. Therefore, A U B C U, completing the proof. □ 

Now, given a metric space X, define a relation ~onI by: 

x ~ y {x, y} C A 

for some connected subset A of V. The properties of reflexivity and symmetry are 
trivial, so we only need to check transitivity. Assume x ~ y and y ~ z. Then, 
{x, y} C A and {y, z} C B , for connected subsets A, B of X. Note that y £ AdB, 
so A UR is connected by the previous proposition, and {x, z} C A U B. Therefore, 
x ~ z, and this is an equivalence relation. 

Definition. The equivalence classes as defined above are called the connected 
components of X . 

Note: The connected components are themselves connected and are maximal ele- 
ments for the property of being connected. 

Example: In Q, the connected components are just individual points. 

17.2. Path-connectedness. 

Definition. Let (X,d) be a metric space, and x,y £ X. A path* from x to y is a 
continuous function c : [0, 1] — > X such that c(0) = x and c(l) = y. 

Definition. (A, d) is path- connected if for all x,y £ X, there exists a path from 
x to y. Equivalently, there exists a continuous function c: [a, 6] — > X such that 
c(a) = x and c(b) = y. 

Proposition. If a metric space is path- connected, then it is connected. 

Proof. Let ( X , d) be a metric space, and let U, V be open sets in X. Suppose 
X = U II V . Notice that if either U or V is the empty set, then the proposition 
is trivially true. Thus, assume that U and V are nonempty. Proceeding toward 
contradiction, let x, y £ X and choose x £ U and y £ V. Now, let c: [0, 1] — > X be a 
continuous function such that c(0) = x and c(l) = y. Then, c -1 (R) is a nonempty 
open subset of [0,1] as 0 £ c _1 (R), and similarly, V , is also a nonempty open 


*This is a topological notion. 
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subset of [0, 1] because 1 G c _1 (V). Also, we have that c _1 (C/) U c -1 (V) = [0, 1] 
and c -1 (Z 7) n c~ l {V) = 0 because c is a well-defined function. However, because 
0 € XJ and 1 G V, this contradicts that [0, 1] is a connected set, so we have a 
contradiction and X must be connected. □ 

However, the converse is not true! For an example of this, see the Topologist’s sine 
curve (or the discrete analog, with sawtooth forms instead of smooth curves). 


Like with connected sets, we can define components on path-connected sets. 

Definition. Let ( X , d ) be a metric space. Define a relation ~ on X such that for 
any x, y G X , x ~ y if and only if there exists a path from x to y. 


We will check that this is an equivalence relation. 

(1) Reflexive: It is obvious that x ~ x, because c(t) = x where 0 < t < 1 is 
clearly a path from x to x. 

(2) Symmetric: Assume x ~ y. Then, given a path c: [0, 1] — > X such that 

c(0) = x and c(l) = y, define another function d: [0,1] — > X such that 

d(t) = c(l — t) where 0 < t < 1. This is clearly a path from y to x. 

(3) Transitive: Assume x ~ y and y ~ z. Then, there exist two paths, 

c: [0,1] — > X such that c(0) = x and c(l) = y, and d: [0,1] — ¥ X such 

that d( 0) = y and d( 1) = z. Define cd: [0,2] — y X such that: 


cd(t) 


c(t) if 0 < t < 1, 


Now, we just need to show that this new function is continuous. This is 
obvious for all t where 0 < t < 1 and 1 < t < 2, because c and d were 
themselves continuous. Thus, we only need to verify continuity at t = 1, 
which can be done using e-S. Therefore, x ~ z. 


Definition. The equivalence classes as defined above are called the path compo- 
nents of X . 

That concludes our time with metric spaces. We will now move on to Calculus! 
Everything in this part of the class will be done in R. 


17.3. Convergence of Series. 

Definition. Let (a n ) be a sequence. Then, 


E a n = L lim s n = L 

77. — ^no 


n — 0 


where s n = ^ a n .* We will say that ^ a n converges if ^ a n = L and L ^ ±oo. 


k = o 


n — 0 


n — 0 


Example: r n = for |r| < 1. 

n— 0 


*L can be oo or — oo. 
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Example: X! n (n+i) = !> because n(n 1 +1) = F - so writing out s n , we get 

71 — 1 

1 f-r, which tends to 1. 

71+1 ' 

Here are a couple of remarks about series: 

(1) If Y a n converges, then a n — > 0 because a n = s n — s„_i. 

(2) If Y a n and Y bn converge, then Y( a n + b n ) converges to Y a n + Y bn by 
the limit theorems. 


Theorem (Comparison Test). For 0 < a n < b n , ifYbn converges , then so does 

Y a n ■ 

Proof. s n = Yk = o a k is nondecreasing if all of the terms a n are positive. Thus, 

71 OO 

Sk < ^ b k < X] bk ' 

k = 0 fc= 0 

So, {s„ |n 6 N} is bounded above, and a bounded monotone sequence always 
converges. Therefore, Y a n converges. □ 

The textbook gives an alternate proof for this test, involving the fact that any 
series whose partial sums form a Cauchy sequence converges (known as the Cauchy 
criterion). This is the case because any Cauchy sequence in K converges. This 
method is also used to prove the theorem regarding absolute convergence as well 
as the Alternating Series Test below. 


Example: Y + converges because + < n ^-i) f° r lai'g e n - 


Definition. Y a n converges absolutely if Y \ a n\ converges. 

71=0 71=1 

Proposition. If a series converges absolutely, then it converges. 

Proof. Notice that 2 a n = (\a n \ + a n ) — (|a„| — a„). Both of these two terms are 
greater than or equal to zero, and by the triangle inequality, we have: 

\a n \ + a n < 2\a„\ and \a n \ - a n < 2\a n \ . 

Furthermore, because Y a n converges absolutely, Y 2|a„| also converges. Then, by 
the theorem, because the two equations above hold, 

'y ' ( | a n | A a n ) (| a n \ a n ) = ^ ) 2 a n — 2 ^ ) a n 

also converges. □ 


Theorem (Alternating Series Test). 
verges if a n > a n +\ and lim a n = 0. 

71— >-00 


OO 

The series Y (— 1 ) n a n, where a n > 0, con- 

71 = 0 


Proof. Supplied in the Textbook, Theorem 15.3. 


□ 


Notice that if ^(— l)"a„ 


L where L ^ ±oo, then 


k 

Y, a n 


L 


< I ot.fe+i I • Fur- 


I n—l | 

tliermore, it is the case that the sequence of even partial sums is decreasing and 
that the sequence of odd partial sums is increasing. 
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18. 03/17/11: More Convergence, Power Series, Differentiability 

18.1. More Convergence. 

Theorem (Ratio Test). Let Y2 a n be a series such that a n > 0 for all n £ N. Then, 
z/limsup^/t 1 < 1, then^2a n converges. 

Proof. Let r = limsup a " +1 . Choose an R such that r < R < 1. Then, there exists 
an TV € N such that supp^, ^±V .. }< R. This implies that aN+k+1 < R for 
all k > 0. Thus, 

fljv+ i < Ron, apf +2 < Ro,n+ i < R 2 on, • • • , a,N+u < R k . 

So, consider YlJL v ■ This converges by comparison with R 2 a N because 

aj < R^apf. Therefore, converges. □ 

Example: ^ is a series that we can easily use the Ratio Test on. 

Theorem (nth Root Test). Let Y2 a n be a series such that a n > 0 for all n £ N. 
If limsup < 1, then Y2 a n converges. 

Proof. Let r = limsup i/af- Choose an R such that r < R < 1. Using e = R — r 
in the definition of limsup, we can see that there exists an N £ N such that 
sup{(ajv) w , (ajv+i) 7 ^, . . . } < R. For n> N, we have (a„)n < R , so a n < R n . 
Then, we can conclude that °n converges by following the same procedure as 
with the Ratio Test above. □ 

18.2. Power Series. 


OO 

In general, a power series is a particular kind of series, of the form a n (x — xo) n ■ 

n—1 

oo 

However, we usually just say xq = 0 and write the power series as Y2 a nX n ■ 

n—1 

Theorem. Let a n x n be a power series. Also, let 

) 3 = lim sup \J | a n \ and R = — . 

Then* , 

(1) If \x\ < R, Y2 a nX n converges absolutely. 

(2) If \x\ > R, Y2 a nX n does not converge. 

Proof. We will prove the two cases. 

(1) We want to show that |a„a:"| converges. We can write because \a n x n \ = 
|a n ||a; n |, we must show that Y2 |a r! ||;r T, j converges. We will use the nth root 
test. 

limsup \J | ci n | \ x n | = lim sup ( i/jonl |*|) = 1*1 limsup yf\ aj = \x\/3 . 

So, the power series converges if \x\(3 < 1, or |x| < j = RJ. 


’''Note that [3 can be infinite. 

^ R is known as the radius of convergence. 
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(2) Assume x/3 > 1. Then, working backwards from the chain of equalities 
above, we have that limsup f/|a n ||x n | >1. If > 1, then it is 

clearly the case that |a„||x| n > 1. However, this would mean that the terms 
of the power series do not tend to zero, so the series as a whole does not 
converge. 

□ 


Here are some very useful power series to know. 

°° x n 

■ “e x ” = exp(x) = £ -^ 

OO 

i(*) = £(-i) r 


n— 0 


r 2n+l 


sin 


n — 0 


(2n + 1)! 


cos 


Or) = £(-ir 


„2n 


n — 0 


(2r 


1 OO 

— = J2 xH for M < !• 


1 — x 


n — 0 


log(l — x) = — V — for \x\ < 1. 
z — ' n 


18.3. Differentiability. 

Let be a function / : (x, y) — > K. where x, y £ K, and let a £ (x, y). 

Definition. / is differentiable at a if lim ^ j or some L £R. Then, 

we will write L = 

However, we have not really defined what lim^^a f(x), or in other words, the limit 
of a function at a, means, so we will do that now, for general metric spaces. 

Definition. Let f : X — > Y where (X, d) and ( [Y . , D ) are metric spaces, and let 
a £ X and y £ Y . Then: 

lim f(x) = y ^==> (Ve > 0)(3<5 > 0) s.t. 0 < d(x, a) < 5 =>■ D(f(x),y) < e . 

x—ta 

An alternate definition of this concept is that if lim f(x) = y, then: 

x—>a 

Jr(i)= f/(x ) , iix?a 
\y, if x = a 

is continuous. 

Theorem. If f is differentiable at a, then f is continuous at a.* 


‘Note that this does not apply for general metric spaces! We are returning to the definitions 
of / and a given in the very beginning of this section. 
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Proof. We can prove this using the e-S definition of the limit of a function. However, 
we will try using the alternate F(x) method instead. 

Because we know that lim )-JA) _ ^ f or some L g K, we can define 

„ , _ x— a ’ 


\ li L-li ) ; if xy^a 
F(x) = < * a 

if x = a. 

where F(x) is continuous. We want to show that f(x) is continuous at a. In 
particular, we know that F(x) is continuous at x = a. Thus, for x ^ a, we have: 

F(x) = => f(x) = /(a) + F{x){x - a) . 

x — a 

Then, because F(x) is continuous at a, for any e > 0, there exists a S > 0 such that 
\a — x\ < S => \L — F(x) | < e. This means: 


( 1 ) 

( 2 ) 


\L — F(x)\ = 


L- 


f(x)-f(a) 


= | L(x - a) + f(a) - /( x)\ < 


I L6 + f{a) - f(x) | < 


In order to prove the continuity of f(x) at a, we must find some 7 such that 
\a — x\ < 7 => | /(a) — /(a:)| < e. We will proceed casewise, for when L is positive 
and negative. 

Let L be positive and e > 0 be given. Then, set 7 = 5. Assuming |a — x\ <7 = 8, 
we obtain: 

l/(o) - /(a 01 < \ LS + f ( a ) “ /0)| < e • 

Therefore, f(x) is continuous in this case. 

Now, let L be negative and e > 0 be given. Using a simple change of variables, 
we will simply write L = —L, and keep L > 0. Notice that, in the series of 
inequalities (1) above, | — L — F{x) \ = |F(x) + L\. Therefore, we can write (2) as 
| fix) — f{a) + LS | < e. Then, letting 7 = <5, and assuming |a — x\ < 7 , we obtain: 

I /(a) - f{x ) | = | f{x) - /(a) | < | f(x) - f(a) + LS\ < e. 

Therefore, f(x) is also continuous in this case, completing our proof. □ 


Now, we will simply list some basic properties of derivatives. We will not prove 
these because the proofs are fairly elementary, and involve only simple limit compu- 
tations. However, the proofs are in the textbook and any other elementary calculus 
textbook. We will just assume that this theorem is true, and use its results liberally. 

Theorem. Let f,g be functions on an open interval in R and let a be in that 
interval. Assume that /, g are differentiable at a. Then, the following are true: 

( 1 ) (cfY(a) = cf'(a), where c is a constant. 

( 2 ) (/ + <?)>)=/>) + <?>). 

(3) (fg)'(a) = f{a)g'{a ) + f(a)g(a). 

?a\ T f ( wn u, ff\'r \ f( a ) 9 (a)~f(a)g'(a) 

(4) Ifg(a) ± 0, then J (a) = . 

For the quotient rule (part 4 above), notice that because g(a) ■=/=■ 0 and g is contin- 
uous at a, there exists an open interval containing a such that g{x) 0 for all x in 
that interval, making the theorem in fact valid as stated. 
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19. 03/29/11: Theorems About the Derivative 
19.1. Review. 

Suppose we have a function / : (a, 6) — > R where (a, 6) is an open interval. If 
liin a ,_ ) . a = L, then L = f'(a), and / is differentiable on a. Equivalently, 

we can define a function F(x) such that F( x) = if x a and F(x) = L if 

x = a. Then, F is differentiable at a if and only if F is continuous at a. 

Example: f(x) = x 2 \ where x( x ) is 1 if x £ Q and 0 if x £ Q. f is differentiable 
at x = 0. Because all sorts of functions are differentiable at a single point, this 
concept isn’t really useful. What we really want is differentiability in the whole 
interval. 


19.2. The Main Results. 


Theorem (Chain Rule). Let I and J be open intervals, and let f: I — > R and 
g: J — >■ R be functions such that if a £ I, then f(a) £ J. If f is differentiable at a 
and g is differentiable at f(a), then g o f is differentiable at a, and 

{9° f)'(a) = g'(f(a))f(a ) . 

Note: This is just the familiar chain rule, or in other words, -ff- = • 4^ . 


Proof. Define a function h : I — > R such that: 


Hv) 


' gfa)-g(/(n)) 
y-f(a) ’ 

V(/(«)), 


if y¥= f(a), 
if y = /(a). 


Then, h(y) is clearly continuous because g is differentiable at /(a). Also, define a 
function GF : I — > R. such that: 


GF( x) 


g(f(x))-g(f(g)) 

5'(/(a))/'(a), 


if i/a, 
if x = a. 


Now, it suffices to show that GF is continuous at x = a. 

Notice that ( hof)(x ) = ■ Then, we have GF(x) = hof(x)- 

when i/a and GF{x) = g' (/ (a)) /' (a) when x = a. We know that (ho f)(x) goes 
to g'(f(a )) as x approaches a by the definition of h and approaches f(a) 

as x approaches a by the differentiability of /, so we are done. □ 


Theorem. Let I be an open interval in R, and let f : I — > R. Suppose Xq £ I 
and that f(x o) is a maximum [or minimum] on I. If f is differentiable at Xq, then 
f'(x 0 ) = 0. 

Proof. Suppose without loss of generality that f'(x o) > 0. Then, we will claim that 
it is the case that for all e > 0, there exists an x such that Xq < x < x + e and 
f(x) > f(x o). Assume toward contradiction that this is not the case. Then, we 
have, for every e, some x such that f(x) < f(x o). This implies that < 

0, which furthermore implies that lim P x l~t( x o'> < w hich is a contradiction 

X— ¥Xo x x ° 

because f(x o) > 0. Therefore, because there exists an x such that f(x) > f(x o), 
f(x o) cannot be a maximum. A similar argument can be used to see that f(x o) 
cannot be a minimum. □ 
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Theorem (Rolle). Let f: [a, b] — > R be continuous and differentiable on ( a,b ), and 
suppose f(a ) = f{b). Then, there exists an x £ (a, b) such that f'(x ) = 0. 

Proof. By the compactness of [a, b\, f attains its maximum (and minimum) on 
[a, b\. If the maximum is attained at an endpoint, then it must attain its minimum 
inside (a, b) or the function must be constant (as the minimum would then be equal 
to the maximum). In the former case, the previous theorem proves our claim, and 
in the latter, the derivative is 0 everywhere. □ 

Theorem (Mean Value). Let f: [a,b] — > R be continuous and differentiable on 
( a,b ). Then, there exists an x £ ( a,b ) such that 

j,,, ^ f(b)-f(a) 

f 0 = r 

Proof. Let t{x) = /( x) — (^f(a) + (x — a) ) • Notice that t(a) = 0 and 

t(b ) = 0. Also, t'(x) = f{x) — • So, by Rolle’s Theorem, there exists an x 

such that 0 = f'(x) — > or f( x ) = ■ □ 

Corollary. Let f: ( a,b ) — > R and suppose f'(x) = 0 for all x £ ( a,b ). Then, f is 
a constant function. 

Proof. If p > q in (a, b), then 0 = - , which implies that f(p) = f(q) by the 
Mean Value Theorem. □ 

Corollary. ///: (as, 6) — > R is differentiable and f'(x) > 0 for all x £ ( a,b ), then 
f is strictly increasing. 

Proof. Notice that f(x) = for some p > q in (a, b), so f(p) > f(q). □ 

Note that this corollary can be generalized to all of the variations of >, namely 
>,<, and <, for which the corollary would state increasing, strictly decreasing, 
and decreasing, respectively. 


19.3. Taylor’s Theorem. 

Let / : (a, b) — > R be differentiable. Then, we can talk about f as a function, 
namely f : (a, b) —> R. So, we could potentially differentiate this function and get 
(f')'(x), or f"{x), and so on, where the nth derivative of f at x is denoted f^ n \ x), 
and is defined to be (/("- 1 ))' (*). 

Definition. C n (a,b) := {/: (a, b) R| f f f^ are continuous on ( a,b ).} 
Notice that C°°(a, b) = H^Li C n {a, b) are the smooth functions on (a, b ). 

As a side note, when dealing with Taylor series, we will always expand the series 
around 0. Refer to the textbook (p. 174) for a brief explanation of shifting series 
in order to expand them around arbitrary points. 
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Definition. Given a function / € C°°(a, b) such that a < 0 < b, the Taylor series* 
of f is defined as 

~ ffiO(Q) x n 
n\ 

n — 0 

This is clearly a power series, but we would like to know if it converges, what it 
converges to, and if it actually has anything to do with the function. Luckily, we 
have a Theorem that tells us just that. 


Theorem (Taylor). Suppose f has n derivatives on (a, b), where a < 0 < b. Then, 
for x £ (a, b), there exists a y between 0 and x ' such that 


f( x ) = /( 0 ) + f'{0) x - 


f"(0)x 2 

2 ! 


H h 


0)x 

(n — 1)! 


n— 1 


f n (y) x r 


Proof. Let M be the solution to the equation 

n — 1 


^ / (fe )(0)x fe Mx n 
k\ n\ 

k—0 


k\ n\ 

for some fixed nonzero x. Furthermore, define the function 

k — 0 


k\ 


Notice that g(x) = 0. Furthermore, ^(0) = 0 and 3 < - fc_1 ' ) (0) = 0 for all k such 
that 2 < k < n. So, by Rolle’s Theorem, there exists an x\ between 0 and x 
such that g'(x\) = 0. Then, again by Rolle’s Theorem, because ^'(O) = 0 and 
g'(x i) = 0, there exists an X 2 between 0 and X\ such that g"(x 2 ) = 0. Continuing, 
we get that there exists an x n -i between 0 and x n -2 such that g^ n ~ l \x n - 1 ) = 0. 
Finally, there exists a y between 0 and x n -\ such that g <Jl \y) = 0. However, 
g {n \y) = M - / (n) (j/), so M = f^ n \y) for some y between 0 and x, proving the 
theorem. □ 


* Technically, the Maclaurin series 

^This means that if 0 < x, then 0 < y < x, and if x < 0, then x < y < 0. 

48 



Math 104, Spring 2011 Vaughan Jones 


Lecture 20 


20. 03/31/11: Differentiation of Power Series 

20.1. Consequences of Taylor’s Theorem. 


Recall that Taylor’s Theorem states that for any n-times differentiable function 
/(&), there exists a y between 0 and x such that: 


/(+) 


/( 0 ) + 


f'( 0)x 

1 ! 


/("-^(O) x 71 - 1 
(n — 1)! 


A simple corollary of this theorem follows. 


f {n \y)x n 

n\ 


Corollary. If there exists a bound on the set {f^ n \y) \ y varies as n varies}, then 
the Taylor series of f converges to f. 


To see this, notice that if there is a bound on the set, as n increases, converges 
to 0. 


Taylor’s Theorem is very powerful, as it is what allows us to compute exact 
values of differentiable functions! 


20.2. Term-by-Term Differentiation of Power Series. 

Theorem. Let fff a n x n be a power series with radius of convergence R. Define 
f(x ) = 'f2a n x n on (—R,R). Then, the following are true: 

(1) na n x n ^ 1 converges. 

(2) f is differentiable on (—R,R). 

(3) f(x) = nanx 71 - 1 on (~R,R). 

Before we get to the bulk of the Theorem, we will make a few easy observations. 


Recall that R 1 = lim|o n |« for any power series. So, for the series in part (1) 
above, we have Rif 1 = lim(n|o„|)«. However, we can show that liuin^oo n* = 1, 
so by the limit theorems, R = Ri, so if Y^a n x n converges, then ]Cna ra ;r n-1 also 
converges. 

Also, the following identity is true for any a, b £ K. such that a — b 0: 

(3) a n -b n = an _ x + + . . . + ab n- 2 + b n-i 

a — b 

Notice that the right hand side is an expression with n terms. 

The following is the infinite analogue to the Triangle Inequality: 


(4) 



< i c ™i 

n— 0 


Finally, recall the very simple identity 


(5) 


1 + 2 + hn = 


n(n — 1) 
2 


Now, we are ready to start. 


Proof. We have already proved (1) in the first paragraph above, and proving (2) 
and (3) are basically equivalent. 

In order to prove (2) and (3), it suffices to show that 
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If R is finite, then choose an r such that 0 < r < i?, |ar| < r < R, and |y| < r < R. 
If R is infinite, then this step is not necessary, and we can simply pick any r. 

Now, by (4), we have that (6) is equal to 

OO 

lim V a n (y n ~ 1 + y n ~ 2 x + y n ~ 3 x 2 + • • • + yx n ~ 2 + i"' 1 - nx n ~ 1 ) 

y—>x ' ^ 
n = 0 

Because (3) is n terms long, we can split up the last nx n ~ l and distribute them to 
every other term to obtain: 

OO 

lim V a n {(y n ~ 1 - x^ 1 ) + x(y n ~ 2 - x n ~ 2 ) 

y—>x ' ^ 
n= 0 

+ x 2 (y n ~ 3 - x n ~ 3 ) + • • • + x n ~ 2 (y - x)) 

Then, if we factor out a y — x from each term and apply (3) to each one individually, 
we obtain 

OO 

lim \y — x\ V a n ((y n ~ 2 + y n ~ 3 x + • • • + x n ~ 2 ) 

y—>x z — ' 

n— 0 

+ x(y n ~ 3 + y n ~ 4 x + • • • + x n ~ 3 ) + • • • + x n ~ 2 ) 

Notice that every term in the above expression is less than r n ~ 2 because \x\ < r < R 
and \y\ < r < R and there are n — 1 terms in the first parenthesized expression, 
n — 2 in the second, and so on until there is only 1 term in the last expression. 
Therefore, by (5), the whole expression above is less than or equal to: 

lim \y — x\ ^M n( - n ^ r"' 2 

y^-x z ' Z 

n= 0 

Now, remember that the radius of convergence of b n x n is equal to B _1 , where 
B = \f | b n | . It can be shown that ^/"'in-i ) conver g eg p so the coefficients of 
this power series converge simply to \a n \. Therefore, because r < R, the whole 
second term is a convergent power series, so the entire term can converges as y goes 
to x, completing the proof. □ 

20.3. Elementary Functions. 


Now, we can define all of these nice functions we’ve previously seen, and prove 
their familiar properties. 


exp(x) = J — 


OO 

• cos(x) = ^ 

n= 0 


{-l) n x 2n 
(2 n)\ 


OO 

• sin(a;) = 

n— 0 


(— 1)" x 2n+1 
(2n+ 1)! 
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20.3.1. The exponential function is never negative. Suppose there exists an a such 
that exp(a) = 0. We can assume a < 0 because if a > 0, then we can reach a 
contradiction immediately through direct calculation. Consider the real number A, 
defined to be sup{a| exp(a) = 0}. Clearly, exp(A) = 0. Consider exp(A + x) for 
some x G R. It is easy to see by direct calculation that the derivative of exp(x) is 
exp(x). Therefore, by the Chain Rule, the derivative of exp(A + x) = exp(A + x). 

Now, consider the Taylor series expansion of exp(A + x), or 

p(«) r n 

Fix) = exp (A + x) = F{ 0) + F'( 0)x + ■ ■ ■ + 

n\ 

for some y between 0 and x. Notice that exp(A-fx) is increasing by direct calcula- 
tion, and every derivative is exactly exp(A + x). Therefore, f' n \y) = exp(A + x), 
so we have a bound on y, and the Taylor series converges to F. However, it is 
the case that F( 0) = exp(A + 0) = exp(A) = 0, so plugging that in to the Tay- 
lor series, we get that exp(A + x) = 0 for all x. This is clearly false, because 
exp(A + (—.A)) = exp(0) = 1. Thus, we have a contradiction, and exp(x) ^ 0. 

20.3.2. Adding real numbers in the exp function. Consider the following equation. 

d /exp(x + a)\ exp(x + a) exp(x) — exp(x + a) exp(x) 
dx \ exp(x) ) (exp(x)) 2 

By a corollary to the Mean Value Theorem, this implies that is constant. 

Therefore, we have exp(x + a) = K exp(x) for all x G R and some K £ R. Let 
x = 0. Then, exp(o) = K , so exp(x + a) = exp(a) exp(x), a familiar identity. 

20.3.3. The limit as exp approaches zero. exp(R) is connected because exp is a 
continuous function, and the range does not contain 0, so the function is always 
positive. 

Now, choose e > 0 such that exp(— e) < 1. Then, it is the case that, for any 
n G N, 

exp(— ne) = (exp(— e)) n 

which is arbitrarily small as n goes to oo. Therefore, lim a ,_ > _ 00 exp(x) = 0. 

20.3.4. exp is a bijection from R to (0, oo). This follows immediately from the 
observation that exp is strictly increasing. 

20.3.5. The log function. We can define log(x) as the inverse function of exp(x), 
where log has domain (0, oo). Therefore, logexp(x) = x, explog(x) = x, and 
log(xjz) = log(x ) + log(y). Also, it is the case that the derivative of log is - by the 
Chain Rule on logexp(x). 

20.3.6. Arbitrary exponential functions and e. We will define a r = exp(rlog(a)) 
for a, r G ffi. such that a > 0. Also, we will define the real number e = exp(l). 
Therefore, we can see that e x = exp(x). 

20.3.7. The Pythagorean trigonometric identity. Consider the following equation. 

-f-(cos 2 (x) +sm 2 (x)) = — 2cos(x) sin(x) + 2 sin(x) cos(x) = 0 
dx 

Thus, as before, cos 2 (x) +sin 2 (x) is a constant function. Plugging in 0, we get that 
cos 2 (x) + sin 2 (x) = 1. 
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20.3.8. Pi. Because cos(l) > 0 and cos(2) < 0 by the error of the alternating series 
function, it is the case that there exists an x between 1 and 2 such that cos(x) = 0 . 
We will define | = inf {a; | x > 0, cos(x) = 0}. 

There are many more properties that we can prove at this stage, but they are 
left as exercises. 

20.4. Some Extra Tidbits. * 


This section includes some counterexamples and odd functions related to differen- 
tiability, as well as another theorem. 

( 1 ) lim x _>.o sin ^ does not exist. 

(2) The function 


f(x) 


x sin i , if x 7 ^ 0 
0 , if x = 0 


is continuous at 0. However, it is not differentiable at 0, as 


lim 

5— >o 


m - /( o) 

6 


5 sin 4 , .1 

lim zr-Q- = lim sin — 

(5— >o d 6— >o d 


which does not exist. 
(3) The function 

g{x) 


x 2 sin ^ , if x ^ 0 
0 , if x = 0 


c2 g - n 1 

is everywhere differentiable, as if x = 0, then lim^o — j— ^ = 0. However, 
consider its derivative. If x ^ 0, then ^ = 2a; sin 1 — cos 1 , and if x = 0, 
then = 0, from the above calculation. Therefore, g'ix) is not continuous 
at 0 . 


Theorem. Let f be differentiable on (a, b), where a < x± < X2 < b, and let c€R. 
If f'{x i) < c < f(x 2 ), then there exists a y such that x\ < y < X 2 and f'(y) = c. 

Proof. Consider the function g(x) = f{x) — cx. Clearly, g is differentiable on (a, 6), 
and its derivative is f'{x) — c. [xi,X 2 ] is compact, so the restriction of g to [a;i,a; 2 ] 
attains its minimum and maximum. Therefore, for some y £ [xi,X 2 ], g' (y) = 0, or 
f(y) — c = 0. If y was equal to either Xi or X 2 , then f'(x 1 ) = c or f'(x 2) = c, 
which contradict our assumptions. Thus, y must not equal either of those points, 
and we are done. □ 


*This section was originally included in lecture 24 by Professor Jones. However, I have moved 
it here so that the flow of the notes is not interrupted. 
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21. 04/07/2011: Uniform Convergence: Guest Lecture by Scott 

Morrison 


21.1. Introduction. 

The next two lectures will be about approximating continuous functions. We will 
try to answer two questions: 

(1) When f n , a sequence of continuous functions, converges to another function 
/, how can we tell if / is continuous? 

(2) When can we approximate a continuous function by so-called “nice func- 
tions”? For instance, can we find a sequence of polynomials (/„) such that 

fn t /*? 

We will answer the first question in this lecture, and the second question in the 
next. 

21.2. The Supremum Norm. 

We will start with a non-example. 


Non-Example: Define f n : [0, 1] — > [0, 1] by 


fn(x) 


nx, if x € [0, i] 

!, if*e[£,l] 


We can see that f n {x) converges pointwise to the function 


fix) 


0, if x = 0 

1, if x e (0, l] 


which is clearly not continuous. So what went wrong? 

The answer is that as x approaches 0, f n {x) takes longer and longer to converge 
to f{x). 

To see this more clearly, take e = What N ensures that \f n (x) — f(x) \ < e 
for all n > N1 Well... 

I fn{x) - f{x) I < \ => - < 2x 
2 n 

So, we can take N = \ , but that’s the best we can do. As x — > 0, N — > oo. 


To avoid this problem, we will define uniform convergence. However, first, let’s 
define the supremum norm. 

Definition. Let f: X — > K. be a function. We will define a norm on the set of all 
functions from X to R, namely 

ll/lloo = sup \f(x)\ 
xex 

This notion can be extended to a metric on the functions from X to R, namely 
dif,g) = \\f -g\\oo = sup \f{x)-g{x)\ 

x£X 

Of course, we can generalize this even further by simply replacing the R with any 
metric space (7, and the familiar metric on R with a metric on C . 

For functions from R to R, d(f , g) < e means that g never gets more than e away 
from /. 
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Definition. A sequence of functions f n converges uniformly if it converges with 
respect to the metric defined above, i.e. 

(Ve > 0)(3 N G N) s.t. (Vn > N ), d(f n , f) < e 

Notice that the statement 

(Ve > 0)(3N G N) s.t. (Vn > N) and (\/x G X ), D(f n {x ), f(x)) < e 

is equivalent to the definition above, where D is the metric on the codomain of / 
and f n . However, if we find such an e for the latter statement and apply it to the 
former, we must change the condition so that d(f n , f) < e, because the d in the 
first statement takes the supremum of values of f n (x) and f(x). 

So what went wrong in our first example? We had an N for each x , but we could 
not find an N which satisfied the condition for all x. 

Theorem. If (/„) is a sequence of continuous functions converging uniformly to a 
function f, then f is continuous. 

Proof. Let xq G X and e > 0 be given. We want to find some S > 0 such that for all 
x with Di(x,xg ) < 5, D 2 (f{x),f{x o)) < e, where Di is the metric on the domain 
of f n and D 2 is the metric on the range of f n . 

Notice that 

Dz(f (x) , f (xo)) < D 2 (f(x), fn{x)) + D 2 (f n (x), f n {x 0 )) + D 2 (f n (x 0 ),f(x 0 )) 

for all n. Because f n converges to / uniformly, we can find an N such that 
D 2 (fN{y), f{y)) < § for all y. Also, because /at is continuous, we can choose a 
S > 0 such that D 2 {fjsi(x), /at(^o)) < f as long as Di(x,xf) < 5. Using this 5 , we 
have: 

D 2 (f(x),f{x 0 )) < ^ ^ = e 

completing the proof. □ 

Exercise: Can you find (/„) which are uniformly continuous and converge uniformly 
to /, where / is not uniformly continuous? If not, can you improve this proof to 
show that if every /„ is continuous, then / must be uniformly continuous? 

21.3. An Explicit Construction. 

Let’s now use these concepts to construct a continuous surjective function from 
the Cantor set to [0,1]. Note that by varying this construction, you can actually 
map the Cantor set to any compact metric space, like [0, 1] x [0, 1]. 

The basic idea will be to construct a sequence of functions /„ : [0, 1] — » [0, 1] 
which are “approximately surjective” when restricted to C , the Cantor set, and 
show that they converge uniformly to some / which must be continuous. We will 
then use this continuity to show that / is actually surjective when restricted to C. 

Recall that C = M 0 fl Mi n M 2 fl . . . where M 0 = [0, 1], Mi = [0, |] U [|, 1], and 
so on, such that 

Mk = -Mk-i U ^- + -Mk-i^j 
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We will define /„ such that /„|m„ : M n — > [0, 1] is surjective, or in other words, 
such that f n when restricted to M n is surjective for each n. Let /o : [0, 1] — ► [0, 1] 
be any continuous function with /o(0) = 0 and /o(l) = 1- Then, define 

(y 0 (3x), ifare[ 0, |] 

h{x) = < §, if x e [§, |] 

L I + i/o(3a: — 2), ifxe[§,l] 

/i|mi is surjective, as /i|[ 0 ,i] = 5/0 is surjective onto [0, \) and /i|[|,i] = 5 + 5/0 
is surjective on [+ , 1] . Therefore, extending the construction, we get, for any k > 0: 

Hfk-i(3x), if ar e [0, |] 

fk(x)=l if ^ €[§,§] 

[5 + lfk-i{3x - 2 ), ifxe[|,l] 

Now, we must check that (/„) converges pointwise. To do this, we will need two 
Propositions. 

Proposition. | f n (x) — /„_ i(x)| < 2~ n+1 for all x € [0, 1]. 

Proof. This is clearly true for n = 1, as fi(x) — fo{x)\ < 1. Now, we will induct on 
n. Then, we have 

fi|/„_i(3a;) - /„_ 2 (3x)|, if x G [0, |] 

\fn{x) - f n -i(x)\ = < 0, ifxe[i,|] 

[ 5l/n-i(3a; — 2) — /„_ 2 (3x — 2)|, if x e [|,1] 

Then, \f n (x) — f n -i(x)\ < \ ■ 2~ n+2 = 2~ n+1 , so we are done. □ 

From this Proposition, we can see that (/„) is Cauchy for each x, so there exists a 
pointwise limit, which we will call /. 

Proposition. | f n {x) — f(x) \ < 2~ n+2 for all x € [0, 1]. 

Proof. First, we can see that, for n, m € N and n < m: 

I fn(x) - fm(x) | < \fn(x) - fn+l(x)\ + \f„+l(x) - f n + 2 (x) \ 

+ ' ' ' + \fm-l(x) + fm(x) | < 2 " +2 

by the previous Proposition. Therefore, by the geometric series formula, we have 
| fn(x) - f(x) | = lim | fn(x) - fm(x)\ < 2 ~ n+ 2 

m—>oo 

which completes the proof. □ 

Therefore, because 2~ n+2 can get arbitrarily small as n increases, (/„) converges 
uniformly to /, and f is continuous by the previous Theorem. Because / is a 
continuous function from [0, 1] to [0, 1] and clearly /( 0) = 0 and /( 1) = 1, by the 
Mean Value Theorem, / is surjective on [0, 1]. 

So, all that is left is to show that the restriction of / to C is surjective. Take 
x € [0, 1] and pick a ye [0, 1] so that f(y) = x. If y G C, then we’re done. 
Otherwise, y € [0, 1] \ M k for some k. However, [0, 1] \ M k is simply a collection of 
open intervals. Therefore, we will make a claim. 

Proposition. For all n > k, f n is constant and independent of n on the closure 
of each interval of [0, 1] \ M k . 
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Proof, fi is constant on [0, 1] \ Mi = [|, |], If /„_ i is constant on [a, b], then /„ is 
constant on [|a, and [| + |a, | + |i>], because M k = \M k - 1 U (| + \M k ~ i), so 

[0, 1] \ M k = |([0, 1] \ M k .i) U Q, |) U ^ + |([0, 1] \ M k ^)j 

□ 

Therefore, by this proposition, we can pick y' such that y' is an endpoint of the 
interval which y belongs to, so f{y') = x. However, the endpoint of any such 
interval is in the Cantor set, so / is surjective on C, and we are done. 
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22. 04/12/2011: Weierstrass Approximation: Guest Lecture by Scott 

Morrison 


22.1. Banach Spaces. 

Recall the supremum norm on the functions from [0, 1] to R, namely 

11/11= sup |/(:r) | 

xC[0,l] 

and the associated metric defined by 

d(f,g) = \\f-g\\ = sup \f(x)-g(x)\ 
xe [o,i] 

as well as the generalization of this norm into C(X), the set of continuous functions 
on X: 

d(f,g) = sup d(f(x),g(x)) 

xGX 

Definition. A vector space with a norm such that the vector space is complete is 
called a Banach space. 

Theorem. C7 ( [0, 1] ) , the set of continuous functions from [0,1] to R, is a Banach 
space; in particular, the supremum norm makes this space complete. 

Proof. Suppose (/„) is a Cauchy sequence of continuous functions. Certainly, f n 
has a pointwise limit / because of the completeness of R. In other words, we know 
that for all e > 0, there exists an N G N such that n,m> N implies 

sup \fn(x) — f m (x)\ < t 
xe[o,i] 

Then, for any given x, \f n (x) — f m (x) I < e > so (f n (x)), a sequence in R, is Cauchy 
and it converges to some number which we will call /( x). So, let’s check that (/„) 
actually converges to this / uniformly. Because this sequence is Cauchy, for any 
e > 0, we can choose N such that \\f n — f m \\ < § for all n,m > N. This means 
that | fn(x) — fm{x)\ < | for all x G [0, 1]. Taking the limit as m goes to infinity, 
namely lirn m ^. 00 (/ m (a:)), we get \f„(x) - f(x)\ < § < e for all x G [0, 1]. Therefore, 

| \fn — /| | < e, so (f n ) converges uniformly to /. By the theorem in the last lecture, 
this / is continuous, so / G C([0, 1]), and we are done. □ 

22.2. Subalgebras. 

Definition. 4CC([0, 1]) isa subalgebra ofC([ 0, 1]) if it is closed under addition, 
multiplication, and scalar multiplication. 

Example: The polynomials are a subalgebra of C([0, 1]). 

Example: Linear combinations of the trigonometric functions, namely 
{cos(7rna:) | 0 < n < oo} U {sin(7rna:) | 0 < n < oo} 
are also a subalgebra of C([0, 1]). 

The main exploratory question for this lecture is “When is a subalgebra of 
C([0, 1]) dense?” There is a Theorem that tells us exactly that, as well as an 
easier corollary that can be proved independently. We will start, however, with 
some definitions. 
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Definition. If X is a metric space, Y C X is dense in X if for all x £ X, there 
exists a sequence ( y n ) C Y such that ( y n ) converges to x. Equivalently, Y C X is 
dense in X if the union ofY and the set of all of its limit points is all of X. Given 
Y C X, the closure of Y , denoted Y, is the union of Y and the set of all of its 
limit points in X. 

Definition. Let X be a metric space. A subalgebra A C C(X) separates points 
if for all distinct x, y £ X, there exists a function f £ A such that f{x) ^ f{y). 

The following two theorems are our main results. 

Theorem (Weierstrass Approximation). The polynomials are dense in C'( [0, 1]), 
i.e. every continuous function on [0, 1] is the uniform limit of a sequence of poly- 
nomials. 

Theorem (Stone- Weierstrass). If X is a compact metric space and A C C{X) 
separates points and contains the function l where i(a;) = 1 for all x, then A is 
dense in C{X). 

Notice that the Stone- Weierstrass Theorem implies the Weierstrass Approxima- 
tion Theorem, because [0, 1] is compact and the function f{x) = x separates points. 

Proposition. If A C C(X) is a subalgebra which does not separate points, then A 
is not dense in C(X). 

Proof. It is certainly the case that C(X) separates points, as given distinct x, y £ X, 
we can take f(z) = d{x , z) where d is any metric on X. Then, / is continuous, and 
f{x) = 0 while f(y) > 0. 

Assume toward contradiction that A C C(X) does not separate points. Then, 
in particular, for some x,y £ X, g{x) = g(y) for all g £ A. We showed above that 
there exists a function f £ C(X) such that d(f(x),f(y)) = L > 0. We will show 
that this / is not a uniform limit of functions in A if (/„) is a sequence in A. 

(7) || fn - /II = sup I fn(z) - f(z)\ > max{| f n (x) - f(x) I, I fn(y) - f(y ) | 

(8) > \{\fn{x) - f{x) I + I fn{y) - fiv) |) 

(9) >^\f{x) + f(y)\ 

( 10 ) >\\f{x)-f{y)\ = \ 

In the above, (9) follows from the equality of f n {x) and f n {y ) as well as the triangle 
inequality, and (10) follows from the positive definiteness of / = d. Therefore, it is 
clear that (/„) cannot converge to /, and A is not dense in C(X). □ 

Therefore, separating points is a necessary and sufficient condition on A in order 
for it to be dense in C(X). Now, we will begin the task of proving the Weierstrass 
Approximation Theorem. 

22.3. Proof of the Weierstrass Approximation Theorem. 
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This proof will consist of four propositions. 

Proposition. /( x) = 1 — \/l — x can be uniformly approximated by polynomials. 

Proof. Define a sequence of polynomials as such: let Pq{x) = 0 and define P n +i 
recursively as P n+ i{x ) = ),( P n (x ) 2 +x) for all n G N. These are all clearly polyno- 
mials. Also, observe that 0 < P n {x) < 1 for x G [0, 1]. To see this, we can simply 
proceed by induction on n. Also, it is the case that 

P n +i{x) - P n+ i{x) = * (P„+i(a) + P n (x))(P n+ i{x) - P n (x)) 

From this, we can see that P„. \-i(x) > P n {x) , which again can be proved by in- 
duction. From these observations, it is clear that ( P n (x )) is bounded above and 
monotonic, and therefore converges to some number in R for each x, which we will 
denote as g(x). 

Consider that 

lirn (P n+1 (x) - \ (P n (x) 2 + x)) = 0 

n— Yoo Z 

by construction. Therefore, g{x) — |( g{x ) 2 + x) = 0, and solving this equation for 
g(x) allows us to see that g(x) = f(x) = 1 — y/1 — x for all x G [0, 1]. 

Therefore, we now have a sequence of polynomials converging pointwise to f(x), 
so it remains to show that it, in fact, converges uniformly. 

As mentioned above, ( P n (x )) is a nondecreasing sequence in n. However, it can 
also be seen that (P n (x)) is a nondecreasing sequence in x. Therefore, because 
the function x is also nondecreasing, |( P n (x ) 2 + x) = P n+ i(x ) is nondecreasing. 
Finally, from this, we can see that P n +i{x) — P n (x) is also nondecreasing in x, a 
fact that can be proved by induction (again). Thus, we have that 

Pn+i(x) — P n {x) < P n+ i(l) + P n ( 1) 
and because this is a telescoping series, this implies that 

P m {x) - P n (x) < P m ( 1) - P„(l) 
for to > n. Now, taking the limit as to goes to infinity, we get 

/Or) - P n (x) < /( 1) - P n (l) 
which is equivalent to the statement 

||/-Pn||</(l)-Pn(l) 

because P n+ \{x) — P n (x ) is nondecreasing in x. Because (P„(l)) converges to 
/( 1), we can make the right hand side arbitrarily small. Therefore, P„ converges 
uniformly in the supremum norm to /. □ 

Proposition. The function f(x) = |a’| can be uniformly approximated by polyno- 
mials. 

Proof. Notice that 

e = x 2 + e — \x\ 2 = (\/ x 2 + e — \x\){\/ x 2 + e + |x|) 

Then, this implies that 

e e i 

— <C — — = e 2 

Vx 2 + e + \x\ ~ V e 
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Now, if 1 — \/l — x can be uniformly approximated by polynomials, then \/l — x , 
yfx, and \J x 2 + e can also be uniformly approximated by polynomials by simple 
manipulations. So, for each n £ N, choose polynomials (/ n , TO ) such that ( f n ,m ) 

converges to x 2 + r as m goes to oo.* 

Define g n = f n , N where N is big enough so that ||/ n ,jv - \jx 2 + £ 1 1 < k We 
will claim that g n converges uniformly to \x\, as: 

II 9n ~ kill < || 9n - \f X 2 + -|| + 1 1 J X 2 + - - |X||| < - + ~^= 

V n V n n ^Jn 

where the last inequality follows from the assumption above as well as the very first 

series of inequalities. Therefore, because ^ obviously goes to 0 as n goes to 

infinity, g n is a sequence of polynomials that converges uniformly to kl- D 

Proposition. Every piecewise linear function is a uniform limit of polynomials. 
Proof Sketch. You can write any piecewise linear function in the form 

k 

f{x) = c+ ^2 a n \x - b n I 

n= 1 

where c G M, k G N, a n , b n G K. Then, we can apply the previous Proposition to 
obtain the desired result. □ 

Proposition. Every continuous function is a uniform limit of piecewise linear 
functions. 

Proof Sketch. Every continuous function on [0, 1] is uniformly continuous, because 
[0, 1] is compact. Thus, choose N € N such that | f(x) — f(y) \ < e if \x — y\ < jj. 
Now, define a function g to be the piecewise linear function which agrees with / 
at the points ^ where 0 < k < N, and is linear in between. Then, as N goes to 
infinity, g converges to /. □ 

This proposition proves the Theorem. 


*Note that what we’re proving here is that if (x n ) is a sequence of limit points of X that 
converges, then the limit point of that sequence is also a limit point of X. It may actually be 
better to prove this fact independently. 
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23. 04/14/2011: The Stone-Weierstrass Theorem 

23.1. Review. 

Theorem (Stone-Weierstrass). Let (X,d) be a compact metric space and A be a 
subalgebra ofC(X, R). If 

(1) A contains the constant function l, where i(x) = 1 for all x € X, and 

(2) A separates the points of X , namely for all x ^ y in X, there exists a 
function f € A such that f{x) ^ f(y), 

then A = C(X, K), i.e. A is dense in C(X, R). 

A review of the relevant concepts follows. 

Remember that for any continuous functions /, g : X — > R, we define: 

• / + 9 = (/ + 9){x) = f(x) + g{x) 

• fg = (fg)(x) = f{x)g(x) 

• A/ = (A f)(x) = A(f(x)) 

An algebra has various properties with the above operations. A subalgebra is a 
subset of this algebra that is closed under these operations. 

Example: Let X = [0, 1]. Then, {/ | /( 0) = /( 1), / continuous} is a subalgebra of 
the continuous functions from [0, 1] to R, denoted C([0, 1],R). 

Example: Likewise, 

k 

Y. a n x n 

n—0 

where x € [0, 1] and a„ € 1 is a subalgebra of C([0, 1],R). 

Also, remember that on C(X, R), there is a norm called the supremum norm 
defined by 

\\f\\ = sup{|/(a;)| | x £ X} 

which makes it a complete metric space. A complete normed metric space is called 

a Banach space. 

23.2. Proof of the Stone-Weierstrass Theorem. 

Remember from last lecture that in C([0, 1])*, yjx is a uniform limit of polynomials. 
From this, we can get the following result. 

Proposition. If f € A, where A is a subalgebra of C([ 0, 1]), then \ f\ G A. 

Proof. Notice that |/| = an d that because A is a subalgebra of C([0, 1]) (and 
hence closed under multiplication), f 2 is in A. Therefore, it suffices to show that 
given any function g £ A such that g(x) > 0 for all x £ X, yfg is in A. 

Rephrasing the last statement, we want to show that for all e > 0, there exists 
an h £ A such that | h(x) — \/g(x)\ < e for all x £ X. Without loss of generality, 
because A is closed under scalar multiplication, we can assume that ||</|| < 1. 
Now, from the statement proved last time, namely that y/x is a uniform limit of 


*This is the same as C([0, 1],M). 
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polynomials, there exists a polynomial p on [0, 1] such that | p(r) — \Jr \ < e for all 
r £ [0, 1]. Therefore, we can simply replace r with g(x ) in order to obtain 

\y{g{x)) - Voix) I < e 

for all x G X. However, p{f(x)) = ( p(f))(x ), so we can simply set h to be p(f), 
completing the proof. □ 

Corollary. If f and g are functions in A, then Mf, g (x) and m.f tg (x) are in A, 
where 


Mf, g (x ) :=ma: x{f(x),g(x)} 
m f,g( x ) :=min {f{x),g{x)} 

Proof. This is immediate from the previous proposition, as 

M f,g{x ) = + 9{x) + | f(x) - g(x ) |) 

m f,g(x) = 7 ^(f{x) + g(x) - | f{x) - g(x)\) 

and A is closed under addition. □ 

Notice that if A is a subalgebra of C(X, R), then A is also a subalgebra of C(X, R). 
Also, the above Corollary can be generalized to any number of finite functions by 
induction. 

Proposition. Suppose A is a subalgebra ofC(X, R) that separates points and con- 
tains the constant functions. Then, for every f € C(X, R), x £ X , and e > 0, there 
exists a function g x G A such that g x {z) < f(z) + e for all z £ X and g x (x) > f{x). 

Proof. By hypothesis, because A separates points, for every y ^ x, there is some 
function h x y such that h XtV (x) yf h x ^ v {y). Now, because the constant function is 
in A and it is a subalgebra, we can choose constants a and b such that h XtV (z) = 
ahfz) + b and the following equations hold: 

h x ,y{x) = f{x) + — 

h x , y (y) = f{y) - | 

Now, for every y ^ x, define the set 

U x , y = {z£ X | h x>y (z) < f(z) + e} 

The continuity of h x y and / make U x , y an open set, as given any z £ U x , y , one 
only needs to adjust z by some 6 in order to ensure that 2 + <5 is also in U XtV . By 
construction of h x<y , x and y are both in U x<y . Therefore, the set of all U XtV where 
y varies in X \ {x}, or {U x . y \ y £ X \ {x}}, is an open cover of X. Because X is 
compact, there must be a finite subcover {y\,y 2 , • • • , y n }- 

Define the function g x = min {h Xtyi ,h XiV2 , . . . ,h XiVn }. By the above corollary, 
g x £ A. Now, we have that g x {x) = f(x) + | which is greater than f(x). Also, 
given any z £ X, it must belong to some U XtVi , so g x (z) < h x , yi (z) < f(z) + e, 
completing the proof. □ 


62 



Math 104, Spring 2011 Vaughan Jones 


Lecture 23 


Proof of Stone- Weierstrass. For this proof, we will show that for every f £ C ( X , R) 
and e > 0, there exists a function g G A such that f(z) < g(z) < f(z) + e. This 
is sufficient because this condition is equivalent to A being dense in C(X, R); more 
informally, we are showing that for any function in C(X, R), there is a function in 
A that is arbitrarily close to it. 

First, for every x £ X, define the set 

V x = {z £ X | g x (z) > f(z)} 

where g x is defined as in the previous proof. Again, because g x and / are both 
continuous, V x is an open set. Furthermore, g x {x) = f{x) + | which is greater than 
f(x), so x £ V x . Therefore, { V x \x £ X} is an open cover of X. Now, because X is 
compact, we can extract a finite subcover {x\, x- 2 , • • • , x n }. 

Define the function g = max{g Xl , g X2 , . . . , g Xn }. From the corollary above, we 
know that g £ A. Now, given any z £ X, it is clear from the construction of each 
g x that g(z) < f(z) + e. Furthermore, every 2 is in some V Xi , so g(z) > f(z). 
Therefore, we have that f(z) < g(z) < f(z) + e, and we are done! □ 
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24. 04/19/2011: Integration Part One 

24.1. A Review of Stone- Weierstrass. 

The theorem states that given C(X, R), the supremum norm, and a subalgebra 
A (namely l £ A and A separates the points of X ), A is dense in C(X, R), or 
A = C(X,R). 

Example: The polynomials are dense in C([a, &],R), as the function x separates 
points. Likewise, the polynomials in two variables are dense in C([a,b ] x [c, d],R), 
because given and (^ 2 , 92 ), the function f(x,y) = ( x — pi) 2 + ( y — P 2) 2 

separates the two points. It is easy to see that this can be extrapolated to R™. 

24.2. Darboux Integration. 

Definition. Let [a, b] be an interval in R. A partition of [a, b] is a subset of [a, b\, 
{t 0) t\, . . . , t n }, such that t\ = a, t n = b, and for all i where 0 < * < n — 1, tj < L+i- 

Definition. Let f : [a, b\ — > R be a bounded function. Given S C [a, b) , we will 
define the following values: 


M(f,S ) = sup f(s) 
seS 

m(/, S) = inf f(s) 

Definition. Let P be a partition. The upper Darboux sum, is defined as 

n 

u (f, P) = £M(/, [L_i,L])(L - t*_i) 

i= 1 

The lower Darboux sum is defined as 

n 

L(f,P ) = £ m (/> [ti-i,ti])(ti - ti- 1 ) 

i= 1 

Clearly, it is the case that 

m(f , [a, b])(b — a) < L(f,P) < U(f,P) < M(f, [a,&])(6- a) 
for any P. This motivates our next definition. 

Definition. 


[/(/) = inf U(f,P) 

L{f) = sup L(f,P) 

p 

In essence, U(f) is the infimum of U(f , P) as you vary the partition you are taking. 
Now, it is clear what our definition of the integral will be. 

Definition. /: [a, b] — »• R is Darboux integrable if L{f) = U(f), and we denote 
the integral as J/ 6 f(x)dx = U{f). 
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Example: Consider a function /: [0, 1] — > R. such that f(x) = 0 if x is irrational and 
f{x) = 1 if x is rational. Then, clearly M(f, [L_i,f,;]) = 1 and m(/, = 0 

for any partition P. Therefore, we can compute the following: 

n 

i= 1 

L{f,P) = 0 

This shows that / is not Darboux integrable. 


Example: Now, consider the more familiar function f(x) = x on [0,6]. For ease 
of working with the partitions, we will assume that our partition divides the in- 
terval into segments of equal width, or in other words, let L = — . Then, clearly 
M(f, [U- i,L]) = ^ and m(/, Therefore, 

2=1 


L(f,P) = Y / 


( i — 1)6 6 


n 


6 2 n{n — 1) 
2 2 


n 


Both 6 n 2n 2+1 ^ an< l b "in tend to so inf U(f,P) < \ and sup L(f,P) > 
However, we cannot conclude that the function is Darboux integrable until we know 
for sure that L{f) is always less than or equal to U(f). In fact, this is our next 
theorem. 


Theorem. Let f: [a, 6] — > R. be bounded. L(f) < U(f). 

Proof. Let P and Q be partitions of [a, 6] such that P C Q. First, we will show 
that 

(11) L(f, P) < L(f , Q) < U(f , Q) < U(f, P) 

We will assume that \Q\ = |P| + 1, as the full argument can be shown through 
induction. Therefore, we have 

P — {^0 ; H f • • • , ti— 1 , ti , . . . , 

Q — {to Vi i • ■ • ? L— i ? L 5 • * • ; 

The middle inecjuality is trivial, and the first and third inequalities can be proved 
similarly, so we will only prove the first inequality, namely L(f,P) < L(f,Q). 
Notice that 

L(f,Q)-L(f,P) = m(f, [ti-i,u\)(u — ti) + m(f, [u, L])(L — u) 

\t-i— i , tf \ ) (ti ti— i) 

> m(f, [tj_i,t*])(u - L- 1) + m(f, [ti-i,ti])(ti - u ) 
—m(f, [ti-i,ti])(ti - U- 1) = 0 

Therefore, for any P, Q such that PCQ, inequality (1) holds. Now, consider PUQ, 
where P and <5 are arbitrary partitions. Applying (1) twice, we obtain 

L(f, P) < L(f , P U Q) < U(f , P U Q) < U{f, Q) 


Thus, we now know that L(f, P) < U (/, Q) for any P and <5- If we fix any partition 
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P, we know that L(f,P) < U(f), because L(f,P) is less than or equal to U(f,Q) 
for any Q. However, this also implies that U(f) is greater than or equal to L(f,P) 
for any P, because our fixed P was arbitrary. Therefore, L(/) < £/(/), and we are 
done. □ 
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25. 04/21/11: Integration Part Two 

25.1. More Darboux Integration. 


Recall that last time, we discussed the Darboux integral. Given a partition P and 
a bounded function / on [a, b\, we have: 


U{f , P) = [L_i,L])(L - ti_i) 

L (f,P) = [ti-x,ti})( U - U- 1) 

U(f)= inf U(f,P) 

L(f) = sup L(f, P) 


f(x)da 


U(f ) = L{f) 


where the final equation only makes sense when U(f) = L(f). 

Also, last time, we proved that L(f,P) < U(f,P) and L{f) < U(f), where the 
crucial lemma was that if we have two partitions P and <5 where PC Q, then 


L(/, P) < L(f , Q ) < U(f , Q) < U(f, P) 


Theorem. Let f be bounded on [a, b\. f is Darboux integrable if and only if for all 
e > 0, there exists a partition P such that L(f,P) > U(f,P) — e. 


Proof. We will go in both directions. 

(-4=) Due to the theorem in the previous lecture, in order to show that / is 
Darboux integrable, we only need to show that L(f) > U(f). Let e > 0 
be given, and let P be a partition such that the inequality in the theorem 
holds. Then, notice that 

L(f) > L(f, P) > U(f, P)-e> U(f) - e 

Because e was arbitrary, L{f) > U(f), so / is Darboux integrable. 

(=>) Let e > 0 be given. Then, because / is Darboux integrable, there exists 
a partition P such that U(f,P) < U(f) + | and a partition Q such that 
L(f,Q) > L(f) — f. To see this, assume that this was not the case. Then, 
there would be some | such that for all partitions P, U(f, P) > U(f) + f . 
However, this would imply that there is some p 2 (/), namely U(f) + |, 
that is greater than U(f) which is still a lower bound for the set of all 
U(f,P). This is a contradiction, because U(f) is the greatest lower bound 

of M/,p)}. 

Now, consider P U Q. By a result proved in the last lecture, we know 
that U(f,P) > U(f,PUQ) and L(f,Q) < L(f,P\jQ). Therefore, we have 
that 

U(f, P U Q)-L(f, PUQ)< U(f , P) - L(f, Q) 

< (U{f) + |) - (P(/) - l) = U(f) - L(f) + e 

However, / is Darboux integrable, so U(f) = L(f), and rearranging the 
inequality, we obtain L(f, P U Q) > U(f,PUQ) — e, which is our desired 
result. 

□ 
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25.2. Riemann Integration. 

Now we will go over Riemann’s definition of an integral, which we will see is 
actually equivalent to Darboux integration. 

Definition. We will define the mesh of a partition P as such: 

mesh(P) = maxjffc — tk-i | fe > 1} 

In other words, the mesh P is the length of the largest subinterval of P. 

The next theorem states another equivalent condition for integrability, but is not 
the Riemann integral. 

Theorem. A bounded function f : [a, 6] — > ffi. is Darboux integrable if and only if for 
all e > 0, there exists a S > 0 such that for all partitions P of [a, b], if mesh(P) < 6, 
then U(f, P) — L(f, P) < e. 

Proof. We will go in both directions. 

(4=) If we assume that mesh(P) < S implies !/(/, P) — L{f,P) < e, then we 
can simply take the partition P that divides [a, b] into subintervals of equal 
length less than 6, and using the previous theorem, we have our result. 

(=>) Suppose / is integrable on [a, b], and let e > 0 be given. By the previous 
theorem, we can choose a partition P such that U{f,P) — L{f,P) < |. 
Now, because / is bounded, there exists a B > 0 such that \f(x)\ < B for 
all x € [a, 6]. 

Let Q be any partition such that mesh(<5) < 5 , and let R = P U Q. If 
we assume that |P| = \Q\ + 1, then, repeating an argument from the proof 
of L(/) < U(f), we have 

L(f, R) — L(f, Q) < B ■ mesh(Q) — (— B) ■ mesh(Q) = 2 B • mesh(<5) 

Let |P| = m. Thus, R can only have, at most, m elements that are not in 
Q. By induction, we can see that, if this is the case, then 

L(f, Q ) — L(f , P) < 2 mB ■ rnesh(P) 

Thus, we can set 5 = so that 2 mB ■ mesh(P) < 2 mB5 = |. Now, 

because |P| < |P|, we have L(f,P) — L{f,Q) < |, and repeating the 
same steps for the Upper Darboux sums, we get U(f,Q) — U(f,P) < |. 
Combining these two facts, we obtain 

U(f, Q ) - L(f, Q ) < U(f, P) - L(f , P)+ e - < i + i = e 

completing the proof. 

□ 


Definition. Let f : [a, b] — > R be a bounded function, and let P be a partition of 
[a, b] . f is Riemann integrable if there exists an r € R. such that for all e > 0, there 
is a S > 0 such that if mesh(P) < S, then 


n 

r - ^2 f( x k){tk - tk-i ) 

fc= l 


< e 


r is known as the Riemann integral of f on [a, b], and is denoted f b f. 
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Note that the symbol for the Riemann integral is the same as the one for the 
Darboux integral. This will be explained by the next theorem. Note, however, 
that for the sake of establishing these two integrals’ equivalence, we will denote the 
Riemann integral as 7 Z J b f. 

Theorem. A bounded function f : [a, b] — > R. is Darboux integrable if and only if it 
is Riemann integrable, and the values for each integral are equal. 


Proof. We will go in both directions. 

(=>) Suppose / is Darboux integrable on [a, 6], and let e > 0 be given. From 
the previous theorem, we can choose S > 0 such that mesh(P) < 8 implies 
[/(/, P) — L(f,P) < e. We want to show that the above condition for 
Riemann integrability is satisfied in this case. So, let P be a partition such 
that mesh(P) < 8. We will also denote J2k=i f( x k)(tk ~ tk-i) as S. 

It is obvious that L(f,P ) < S < U(f,P). Now, notice that by the 
previous theorem, we have 


U{f,P) < L(f, P) + e < L(f) + e = 
L(f,P) > U(f , P) — e > U(f) — e = 



f + e 



— e 


Therefore, f b f — e < S < J b f + e, so because e was arbitrary, / is Riemann 
integrable, and 1Z J b = j\ 

(<=) Suppose / is Riemann integrable, and let e > 0 be given. Choose 8 and r as 
given in the definition of Riemann integrability. Now, let P be a partition 
such that rnesh(P) < <5 such that |P| = n. For each tk G P, there is an 
Xk G [ tk-i,tk ] such that f(xk) < m(f, [tk-i,tk]) + e. Again, such XkS exist 
by the definition of infimum. Now, if we consider these Xk, it is the case 
that 

n 

T: f(xk)(tk ~ t k - 1 ) < L(f , P) + e(b - a) 

l 

Furthermore, by assumption, |r — ]Cfc=i f{ x k){fk — ifc-i)| < £• Therefore, 
substituting S for the summation, we have 


L{f) > L(/, P) > S — e(b — a) > r — e — e(b — a) 


Thus, L(f) > r by the arbitrary nature of e, and similarly, U(f) < r. 
Therefore, because we know L(/) < U(f), L{f) = U(f) = r, / is Darboux 


integrable and f b f = 1Z J b f. 


□ 


Now that we have proved this theorem, we can remove the 7Z from the Riemann 
integral and use one symbol for both, namely f b f. 
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26. 4/28/11: The Fundamental Theorem of Calculus 

26.1. Integration Facts. 

Recall the symbol J b f(x)dx where / is a bounded function from [a, b] to R. We 
have learned two equivalent ways of calculating the integral: 

• The Darboux integral: J b f{x)dx = U(f) where 

U(f) = inf U(f,P) = $>(/, [ U-i,U]){ti - U- 1) 

L(f) = sup L(f,P) = [ti-i,ti])(ti - ti- 1) 

and the integral is defined if U(f) = L(f). 

• The Riemann integral: Take Xi G \ti-i,tj\ for all i. Then, 


rb 

/ f(x)dx = f(xj)(tj - ti- 1) 
J a 


The integral is defined if for all e there exists a S such that there exists an 
r that satisfies | f(xi)(ti — U-\) — r\ < e if mesh(P) < S. 

Our goal today is to prove the Fundamental Theorem of Calculus. 


Theorem. Any monotonic function is integrable. 
Proof. Exercise. 

Theorem. Any continuous function is integrable. 


□ 


Proof. We will use the previous theorem that states that a function / is integrable 
if and only if for all e > 0, there is a partition P such that U (/, P ) < L(f, P) + e. 
Let e > 0 be given. / is uniformly continuous because [a, b] is compact. Thus, there 
exists a d > 0 such that \x — y\ <6 implies | f(x) — f(y)\ < 53^ for all x, y € [a, b]. 
So, choose a partition P such that max{L — i;_ 1 1 i = 1, . . . , n} < S. We can see 
that 

M(/, [ti- i,t*]) < m(f , + 


b 


because each subinterval has width less than <5, so the function does not differ by 
more than -A— in each subinterval. Therefore, we now have 

b—a ‘ 

n n / n \ 

5>(/. [ti-i,ti]){ti-ti-i) < ^2 m{f , [L_i,L])(ti-L-i)+( ^2(ti - U- 1 ) j (^-^) 

□ 


i— 1 


i—1 




which implies U (/, P) < L(f, P) + e. 

26.2. Properties of the Integral. 

Proposition (Linearity of /). Let f,g: [a, 6] — > R. If fdx and f^gdx exist, 
then f b (f + g)dx exists, and J b (f + g)dx = J b fdx + J b gdx. 


Proof. We will use Riemann’s method of integration. Let e > 0 be given. Be- 
cause / and g are integrable, there exists a 5 > 0 such that mesli(P) < 6 implies 
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I E/(*i)(*i — U-i) ~ J ,fi x )dx | < e, and likewise for g, for any choice of XiS in 
each subinterval [t,_ i,U}. Therefore, we have 

+ g)(xi){ti - ti- 1 )- / f(x)dx — / g(x)dx = 

J a J a 

£/(*<)& -ti-i)-/ f{x)dx^j + (^2g(xi){ti - ii_i) - j g(x)dx^j 


The latter expression is less than e + e, so because e was arbitrary, we are done. □ 

Another part of this theorem is that for any ceK, cf(x)dx = c J ^ f(x)dx. The 
proof of this statement is left as an exercise. 

Theorem. If f is integrable, then |/| is also integrable, and 


fdx 


< I' \f\dx 

J a 


Proof Sketch. The crucial lemmas are that 

M(\f\, [L_i,L]) - m(|/|, < | M(f, [L_i,L]) - m{f, [L_i,L])| 

which follows from \a\ — |6| < \a — b\ for any a, b £ K, and the fact that if f,g are 
integrable and f(x) < g{x) for all x € [a, b), then f(x)dx < g[x)dx. To see 
this fact, consider g — f . g — f > 0, so J^(g — f)dx > 0, which implies, by the 
previous theorem, that J b gdx > J ^ fdx. □ 

Theorem. If a < b < c for a, b, c £ ffi. and f is integrable on [a, b] and [6, c] , then 
f is integrable on [a, c] and 

r b 


nC pO r-C 

/ f(x)dx = / f{x)dx + / f(x)dx 
'a J a J b 


Proof. By Riemann’s method; left as an exercise. 

26.3. The Fundamental Theorem of Calculus. 


□ 


Theorem (The Fundamental Theorem of Calculus, Part 1). Let f be differentiable 
on (a,b) and continuous on [a, b]. If f is integrable on [a, b], then 

rb 


I f'{x)dx = f{b) - /(a) 
J a 


Proof. We will proceed by Riemann’s method of integration. Let e > 0 be given. 
Choose a partition P such that 

rb 


[ f'{x)dx - ^2 f( x i)(ti - U- i) 

J a 


< e 


for all x i £ [ti-i,ti]. By the Mean Value Theorem, for each interval [L_i,L], there 
exists an Xi € (L_i,L) such that f'(x) = ■IVJ-./W- 1 ) . Then, we have 

n n 

- U-i )f{xi) = ~ f(ti- 1 )) = f(b) - f(a) 


*Note that this theorem is a version of the triangle inequality. 
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Therefore, the above chain of equalities implies that | f(b) — f(a) — J b f(x)dx\ < e, 
so we are done. □ 

Theorem 12 (The Fundamental Theorem of Calculus, Part 2). Let f be an inte- 
grable function on [a, b], and define the function F{x) = f f(t)dt. Then, 

(1) F(x) is continuous. 

(2) If f is continuous at Xq, then F is differentiable at Xq, and F'(xq) = f(x o). 

Proof. Not covered in class, due to time constraints. Professor Jones referred the 
class to the proof in the textbook. □ 
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Appendix: Significant Results Proved in Homework 

This is a list of all of the results that have been assigned as homework that we 
should know. 

(1) Let S and T be nonempty subsets of R with the property that s < t for all 
s £ S and t £ T. Then: 

(a) S is bounded above and T is bounded below. 

(b) sups' < infT. 

(2) Let I be the set of real numbers that are not rational numbers, and let 
a, b £ R. If a < b, then there exists an x £ I such that a < x < b. 

(3) Let A and B be nonempty bounded subsets of R, and let S be the set of 
all sums a + b where a £ A and b £ B. Then: 

(a) sup S = sup A + sup B. 

(b) inf S = inf A + inf B. 

(4) Every element of a complete ordered field is the supremum of the set of 
rationals that are less than it. 

(5) In a complete ordered field, a nonzero element is positive if and only if it 
is a square. 

(6) Let F and G be complete ordered fields. There exists a unique Injection 
/ : F — > G such that 

f{x + y) = f{x) + f(y) and f(xy) = f(x)f{y) . 

(7) Let (s n ) be a sequence in R such that s n > 0 for all n £ N. If lims„ = 0, 
then lim yfs^, = 0. 

(8) Let (s n ) be a convergent sequence. If lims n > a, then there exists an 
N £ N such that n > N implies s n > a. 

(9) Let R(x) be the field of rational functions (with real coefficients) in x. Then, 
the set of elements of R(x) of the form where P and Q are polynomials 
such that the coefficient of the highest power of x is positive satisfies the 
properties required to make R(x) into an ordered field. 

(10) R(x), as defined above, is not Archimedean, and hence not complete. 

(11) Every positive element of R has a unique positive nth root, for all n £ N. 

(12) The sum of two Cauchy sequences is Cauchy. 

(13) The product of two Cauchy sequences is Cauchy. 

(14) Let (s„) and (t n ) be bounded sequences in R. Then, 

limsup(s n + t n ) < lim sup s n + lim sup t n . 

(15) A sequence (s n ) is bounded if and only if lim sup |s n | < oo. 

(16) Addition and multiplication of sequences (in the natural way) in any or- 
dered field makes the set of all sequences into a commutative ring. However, 
this structure does not define a ring structure on equivalence classes of se- 
quences, as defined in Lecture 7. 

(17) Let (s n ) be a sequence of nonnegative numbers, and for each n, define 

<x n = £(si + s 2 H b s n )- Then, 

(a) lim inf s n < lim inf a n < limsupCT„ < lim sup s n . 

(b) If lims„ exists, then lim a n exists, and lims n = lim cr n . 

(18) Let (A, d) be a metric space. Then, D(x, y ) = also defines a metric 

on X and a subset U of X is open in (A, d) if and only if it is open in (A, D). 
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(19) Let d:XxX->Rbea function satisfying all of the properties of a metric 

except d( x, y) = 0 => x = y. Define ~ on X by x ~ y d(x, y) = 0. 

Then, ~ is an equivalence relation, setting L>([x],[j/]) = d(x,y) is well- 
defined, and D makes the set of equivalence classes of X into a metric 
space. 

(20) Let {X,d) be a metric space. Then, \d(x,y) — d(x,z)\ < d(y,z). 

(21) Let ( x n ) and ( y n ) be two Cauchy sequences in (X,d). Then, (d(x n ,y n )) is 
a Cauchy sequence in R. 

(22) Define a function d((x n ), ( y n )) = lim d(x n , y n ) on the set of all sequences in 
a metric space ( X , d). Also, define a relation ~ on the set of all sequences 
in (X,d) by ( x n ) ~ (y n ) *£=> d(x n ,y n ) — > 0. d then defines a metric on 
the set of eciuivalence classes of Cauchy sequences, which we will denote X. 
Furthermore, given that X can be embedded into X by defining iglto 
be the eciuivalence class of the constant sequence of x, X is dense in X. 

(23) The metrics defined by the norms || • ||i, || • II 2 , and || • ||oo are equivalent.* 

(24) Equivalent metrics define the same topology. 

(25) Every polynomial function p(x) = ao + a\X + ■ ■ ■ + a n x n is continuous on 
R. 

(26) The Cantor set is uncountable. 

(27) Let A be an infinite set and F be a finite set. Then, |A| = \A U F\. 

(28) A uniformly continuous function maps Cauchy sequences to Cauchy se- 
quences. 

(29) Let A be a dense subset of the metric space (X,d), and let ( Y,D ) be 
a complete metric space. Then, given a uniformly continuous function 
f: A — > Y, f admits a unique continuous extension to X. 

(30) Any open subset U of R is a countable union of disjoint open intervals. 

(31) Let A be a compact metric space, and Y be a metric space. Then, any 
continuous function from X to Y is uniformly continuous. 

(32) Let ( X , d) be a compact metric space and let X l] be the set of all sequences 

00 . 

in X. Then, D((x n ), ( y n )) = ^ defines a metric on X H for which 

n— 1 

it is sequentially compact, and hence compact. 

(33) Assume that any finite map in the plane can be colored with four colors 
so that no adjacent countries have the same color. Then, any countably 
infinite planar map can also be colored with four colors. 

(34) A compact metric space is complete. 

(35) The closure of a connected subset of a metric space is also connected. 

(36) Let E and F be connected subsets of a metric space. If E and F have empty 
intersection, then their union is connected. However, their intersection 
(regardless of whether it is empty or not) need not be connected. 

(37) Cauchiness is not a topological property, i.e. there exists an example of 
a set which can take two metrics which define the same topology, but for 
which a sequence exists which is Cauchy in one metric but not the other. 

(38) Define C(v,r ) C R 2 to be the circle centered at v of radius r, namely if 
v = ( a , b), then C(v, r) = {(&, y) \ (x — a) 2 + (y — b 2 ) = r 2 }. C(v, r) is 
connected and path-connected. 


*The notion of equivalent metrics is the same as the notion of equivalent norms detailed in 
Lecture 16. 
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(39) 

(40) 

(41) 


(42) 

(43) 

(44) 


(45) 

(46) 


(47) 

(48) 

(49) 


(50) 

(51) 

(52) 


(53) 

(54) 


(XLi 0), ^), also known as the Hawaiian earring, is path-connected. 
The continuous image of a path-connected metric space is path-connected. 
Let c: R — > R and s: f -> R be differentiable functions such that c(0) = 1, 
s(0) = 0, c'(x) = —s(x) for all x, and s'(x) = c(x ) for all x. Then, 
c{x) = cos(a:) and s(x) = sin(x) for all x. 
cos(A + B) = cos(A) cos (B) — sin(A) sin(H) and 
sin(A + B) = sin(A) cos(H) + cos(A) sin(H). 

cos (t) = 0 for some unique t, between 1 and 2, and cos(x) > 0 for all 
x G (—t, t). 

Let 7 r be the real number equal to 2 1 as defined in the item above. Then, 
the following are true: 

cos — x'j = sin(:r) 

sin — x'j = cos(x) 
sin(a: + 7r) = — sin(a:) 
cos(cr + 7r) = — cos(a:) 

exp(x) is a bijection from R to (0, oo), and log(x) is differentiable such that 
log'(x) = i. 


log(l - x) 


E 


X 


n 


n 


for all x € (—1, 1). 

Let / : [0, 2] — >• R. be continuous and differentiable in (0, 2), and let /( 0) = 0. 
If —3 < f{x) < 4 for all x € (0, 2), then —6 < /( 2) < 8. 

Let S' 1 := {(x, y) € R 2 | x 2 + y 2 = 1}. There is a unique 6 G [0, 27r) such 
that x = cosd and y = sind, known as the angle between the positive x 
axis and the ray going from the origin through (x,y). 

The trigonometric polynomials, i.e. 


k 

a n sin nO + b n cos n6 

n——k 


where a n and b n are real numbers and k is a positive integer, are dense in 

C(S' 1 ,R). 

| cos(a’) — cos(y)| < \x — y\ for all x, y € R. 

Let / be a differentiable on R such that a = sup{|/(a:)| | x G R} < 1. Then, 
for any Sq G R, the sequence defined by s n +i = /(s„) converges. 

Let / be a bounded function on [a, 6], such that |/(a;)| < B for all x G [a, 6]. 
Then, for all partitions P of [a, 6], it is the case that 

U(f 2 ,P) - L(f, P) < 2 B(U(f, P) - L(f , P)) 

Also, if / is integrable on [a, 6], then / 2 is integrable on [a, b]. 

Let f(x) = a;sgn(sin L) for x ^ 0 and /( 0) = 0. / is not piecewise contin- 
uous nor piecewise monotonic on [—1,1], but it is integrable on [—1, 1]. 
Suppose / is a continuous function on [a, b] such that f(x) > 0 for all 
x G [a, b]. If / a & f(x)dx = 0, then f(x) = 0 for all x G [a, b ]. 
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(55) Let / be a continuous function on [a, b] such that f b f(x)g(x)dx = 0 for all 
continuous functions g on [a, b\. Then, f(x) = 0 for all x € [a, 6]. 

(56) Assume you are standing at (0, 0), the origin in M 2 . Around you are circles 
of equal nonzero radius on every point (a, b) where a, b £ Z. Then, you can 
neither see infinitely, nor can you see arbitrarily far. In other words, there 
does not exist a ray from (0, 0) that does not, at some point, hit a circle, 
and for every radius of the circles, there exists some R £ ffi. such that the 
length of the ray is always less than R. 

Note that there are further concepts not covered in these lecture notes in the notes 
provided by Professor Jones about Metric Spaces and Cardinality, as well as extra 
exposition and concepts in the course textbook, Elementary Analysis: The Theory 
of Calculus, 1st edition, by Kenneth A. Ross, part of the Springer UTM series. 
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